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ABSTRACT 



The relationship of manory to higher thought processes was examined usiiig 
a sanole of rural/ Caucasian, fi^fth grade childx^* 

Jensen (X969) # in his article **Kw Much Can We Boost Scholastic Achieve- 
ment and IQ?** was the most recent proponent of a two^factor model of intelligence. 
According to this theory^ mental abilities can be divided into maoory and higher 
mental processes labeled **Level I** aiid *'Level II** respectively by Jensen. Con- 
siderable research was generated as a result of the theory. Stevenson et al. 
conducted research studies to examine the performance of lower and middle class 
preschool children on a sample of tasks chosen as operational izations of Level I 
intelligence and Level II intelligence. Tests of predictions derived from 
Jensen*s theory of intelligence provided little support for the theory. fOie 
results of Stevenson's study could not be considered refute the two-factor 
theory, however^ since I^vel II abilities are not predicted to emerge until 
after preschool* A more recent study employing multiple opera tionalizations 
of each of Level I intelligence and Level II intelligence^ and using children 
at a more appropriate age level , was reported by Jensen in 1973* Jensen factor 
analyzed a lar^e battery of memory^ intelligence^ and achievement tests. Itiree 
factors emerged^ including a factor corresponding to Jensen's Level I intelli- 
gence# and two factors which Jensen# using Cattell's terminology^ labeled 
Level II fluid ability and Level II crystallized ability. The present study 
employed statistical methods characteristic of construct validation to examine 
a battery of manory, intelligence, and achievement tests, seeking evidence of 
the existence, convergent validity and discriminant validity of the constructs 
of Level 1 and Level II intelligence. 

In the present study# a principal compOTtents factor analysis followed by 
a promax rotation to oblique simple structure was pevforme^l, following Jensen's 
methodology. To examine the convergent and discriminant validity of each of 
the constructs* Campbell and PisJce's multitrait-multimethod matrices were con- 
structed. The methods invo?*ved were gropp vs. individual adninistration for the 
first matrix and verbal vs* nonverbal response mode for the second. Each of 
these analyses was performed first using the entire battery of fifteen variables* 
^e nine variables used in the second set of analyses were tliose judged to be 
*'purer" measures of Level I and Level II intelligence. 

In early fall of 1974, 221 rural Caucasian fifth grade children from a 
midwest school district were tested* specifically for this study* fOie first 
factor analysis using all fifteen variables yielded six factors providing 
little support for the two-factor thsory. Using all fifteen variables there 
was little support for either the convergent or the discriminant validity of 
the constructs. l!he factor analysis usincj the nine '^purer*" measures yielded 
thr-^ factors, again providing little support for the theory. Examination of 
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the TDUltitrait-multimethod matrices provided little support £or the convergent 
or discriminant validity of the constructs. In conclusion, the study calls 
into question the existence of the constructs of Level I and Level II intelli^ 
gence as defined by Jensen and earlier investioators * In particular, there is 
little support for the existence of Level I intelligence as ^ coherent 
psychological trait. 

The study is significant given the controversy surrounding Jensen^s 
theory of intelligence. Although the study does not examine differences 
between racial or SES groups, It suggests that Jensen^s constructs do rot con^ 
stitute coherent psychological traits, precluding their inclusion in a worlring 
theory of intelligence. Furthermore, the results are of use to educators, 
cautioning them against the use of differential instructional approaches wxth 
^ildren from different SES groups, as Jensen suggested. 
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INTRODUCTION 



RATIONALE FOR THE STUDY 

The relationship of rote meiaory to higher mental processes has been a 
subject of speculation since the time of Binet* fOien Binet formulated his 
first description of intelligence (Binet & Henri, 1895), he included memory 
as one of the more conqplex functions which provided significant information re- 
garding an Individual's ability to conqprehend* Binet's second formulation of 
intelligence placed more emphasis on judgment, and he eventually concluded that 
mOTory was not among the best predictors of irtelligence. By 1905, tests of 
m^noiry were of secondary importance in the Binet and Simon scale, along with 
tests of coordination and attention* 

Thorndike's major contribution to intelligence theory was contained in 
the 1927 publication. The Measurement of Intelligence (Thomdike^ Bregman, 
Cobb, & Woodyard, 1927)* Thomdike held that intellect was divided into two 
parts* The lower part of intellect was used in **connection forming^** or the 
association of ideas* 'Hie higher part of intellect was involved in abstrac- 
tion, generalization, and seeing relationships* Within Thorndike's theory, 
rote memory would require only the lower part ofvintelligence* 

A more recent conclusion concerning the separation of memoiry and higher 
mental processes was derived by J* p* Guilford using factor*ana lytic techniques* 
Guilford (1956) identified two major classes of mental abilities, which he 
designated "memory factors'* and **thinking factors*** 

In 1969, A* R* Jensen published a controversial article in the Harvard 
Educational Review which introduced a theory positing two genotypically based 
types of intelligence, denoted Level I, **associative ability^ and Level II, 
'^Conceptual ability** (Jensen, 1969)* The theory predicts interactions among 
types of intelligence, social class, and race* 

This report examines the relationship of memory to higher mental processes 
by the use of various multivariate statisticed procedures* Inasmuch as Jensen*s 
formulation of the distinction between memoiry and higher mental processes is 
more recent, his terminology has been adopted in the following discussion* 
The mental ability required for short-term rote memory tasks will be referred 
to as Level I ability, and conceptual ability will be referred to as Level II* 
.The question of distinctness of mcsnory and higher mental processes can then 
be phrased as followst Is Level I ability distinct from Level II ability? 
This formulation suggests the machinery ol: construct validation as appropriate 
for answering the question* 



PURPOSE 



The purpose of this research was to determine whether the proposed con*- 
structs of Level I intelligence {m^moiry) and Level II intelligence {concep- 
tual ability) could be empirically supported When ^ploying several operationali- 
zations of each construct; for this study a sample of approximately 200 white 
children aged ten to eleven was used. 

This research is different from earlier studies in the following ways: 
(a) There are multiple operational izat ions of Level I and Level II intelligence 
administered to each child; (b) There is a systmatic attanpt to study the 
interaction of method of measuring with each of the proposed traits of Level I 
and Level II intelligences (c) Itiere is no confoundiiig of race and seS since 
all children are whiter and (d) Children tested were ten and eleven years old 
allowing for the maximum developonent of Level I and Level II intelligence. 

Several systematic statistical investigations are conducted* Inferential 
and correlational techniques prescribed by Cronbach and Heehl (1955) and Campbell 
and Piske's (1959) multitrait*multimethod matrices are used to examine the 
adequacy of the Level I and Level II constructs. Opera tionalizat ions of the two 
constructs were chosen so as to allow the construction of two multitrait*multi- 
method matrices, employing the methods of individual versus group administration 
and of verbal versus nonverbal response mode. If results had supported the 
existence of the constructs then additional analyses would have been performed, 
examining the usefulness of the constructs as well as theoretical predictions 
concerning social class differences and hierarchical dependence. Inasmuch as 
the constructs were not substantiated, results of the study were examined with 
reference to several other theories of intelligence* 



RESEARCH HYPOTHESIS 

Three major hypotheses concerned with the existence of the constructs of 
Level I and Level II intelligence as coherent psychological entities are pro- 
posed in this study. 

Hypothesis I 

Factor analysis of a large test battery consisting of multiple operationali- 
zations of both Level I and Level II intelligence will yield three main factors, 
corresponding to factors which Jensen (1973) labeled fluid intelligence (designated 
3f) and crystallized intelligence (designated ^p) with reference to Cattell (1963) ^ 
both considered types of Level II intelligence, and a factor labeled memory, 
representing Level X intelligence. 



Hypothesis II 

Using two multitrait-multimethd matrices as described by Campbell and 
Piske (1959), evidence of the convergent validity of each of the constructs 
of Level I and Level II intelligence will be provided as follows: The inter- 
correlations among the opera tionalizat ions of both of the two constructs in 
each matrix will be significantly greater than zero. 



Hypothesis III 



Using two multitrait-multimethod matrices as described by Campbell and 
Fiske (1959) f evidence of the discriminant validity of b:>th of the constructs 
of Level I and Level II intelligence will be provided as follows: In each 
matrix, the correlation between any two operational isat ions of the same con* 
struct will be higher than either of their correlations with any operationaliza- 
tion of the other construct* 
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BACKGROUND AND REUTED LITERATURE 



Many symposia held by educators^ psychologists, emd philosophers have 
sought to define the concept of intelligence* As early as the fifteenth centuiry 
men spoke of "intelligentia* as a unitary thing which guided the actions of all 
men (Spearman, 1927) . 

in the mid-nineteenth century Herbert Spencer forBtulated a definition of 
intelligence ^ich relied upon Datrwin's theoiry of evolution. Spencer, a biologist, 
defined life as the continual adjustment of internal relations to external con- 
ditions* Intelligence was responsible for achieving the adjustment in men, 
while instinct was responsible in animals* In the light of Dairwin's theoiry of 
evolution, the concepc of intelligence thus became linked with heredity and had 
obvious inq^lications for the study of individual differences among people 
(Guilford, 1967, chap* 1)* 

After Spencer's introduction the concept of intelligence quickly became 
popular among psychologists* One result of the popularity was the development 
of numerous intellectual or aptitude tests. The rapid developntent of the tests, 
however, was not accompanied by £ui equally rapid development of curiosity 
regarding the fundamental nature of human intelligence (Guilford, 1967, chap* 1) * 
Guilford reviews the demands v^ich resulted in the rapid development of these 
tests* For example, Binet and Simon were commissioned to identify mentally 
deficient children in French schools* In Germany, mental tests were developed 
in order to conduct experimental studies in psychopathology and various educa- 
tional problems* Galton, in Great Britain, wasTdeveloping mental tests to 
study the^ relationship between heredity and individual differences* Little 
interest existed in studying the nature of intelligence itself* 

with the development of so many mental tests, pressure arose in the psycho- 
logical cot'anunity to reach agrement on a definition of intelligence* Numerous 
symposia were conducted but without consensual agreement on a definition* Spearman 
(1927) summed up the situation in his assertion that the term ^intelligence," 
with so many diverse meanings, in reality had no meaning at all. A consideration 
of a few of the diverse definitions of intelligence which were developed will 
serve to support Spearman's position* 

One of the earliest and perhaps most influential members of the psychological 
cc^nmunity concerned with a practical definition of intelligence was Alfred 
Binet* His definition of intelligence was never published in a final form 
(Peterson, 1925), but his point of view has influenced the development of 
numerous mental tests* Binet did not emphasize sensory and jikotor functions as 
did Galton and other British psychologists* Although Binet placed some emphasis 
upon memory and imagery, he heavily stressed judgment, coimton sense, and problem 
solving, all abilities which he believed to involve direction, comprehension, 
invention and criticism* Recognition of this multitude of abilities caused 
Binet to regard intelligence as very complex* He viewed mental abilities as 
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being independent and unequal, and expected that# for example^ an individual 
with little memory might be very capable o2 maki.ng judgments* Each of the various 
subtests he and Simon developed was constructed to measure only one of man's 
intellectual abilities (Peterson* 1925). Ironically, Binet chose to represent 
man's intellectual complexity as a single soore# the ration IQ* This decision 
contradicted his belief that intelligence was made up of many abilities* It has 
been speculated (Guilford, 1967, chap* 1) that the decision for a single score 
was to facilitate making a single administxative judgment on each child tested* 

''Appearing coomionly in definitions of intelligence is the statement that 
it is learniiig ability or the ability to learn [Guilford* 1967# p* 74]*" This 
conception of intelligence relies upon the assumption that learning ability is 
a universal trait regardless of the substance or activity that is being learned* 
Gain s&jres are used as the index of rate of learning^ and it is hypothesized 
that learning rate is identical to intelligence* Conclusions from experiments 
using gain scores suggests however^ that "learning ability" is not unitary 
(Guilford# 1967, chap* 1), Other experiments have attempted to examine the rela- 
tionship of learning scores to measures of intelligence* In particular^ scores 
on recognized intelligence tests were correlated with gain scores on achievement 
tests* Guilford also summarized a sample of such studies and concluded that 
"learning ability" and intelligence involve many different component abilities* 
The number of components they share depends on the degree of similarity between 
the learning task (achievement test) and the intelligence measure* 

£* G* Boring (1950) directed the .efforts of psychologists towax'd defining 
intelli'^ence as whatever intelligence tests measure* He suggested the use of 
this operational definition to eliminate such definitions as "global capability*' 
and "the ability to be rational," which have no ^pirical referents. Boring 
made this recommendation in order to decrease the ambiguity of the definition 
of intelligence used by psychologists as a basis for their test development* 
One problem with his approach is that each psychologist's freedom to operation- 
alize the construct differently might still result in little information of 
general significance or usefulness (Guilford^ 1967# chap* 1)* In light of this# 
Boring gave some direction for determining a unitary referent for intelligence* 
He recommended that the method of correlation would provide empirical informa* 
tion to be used in establishing what intelligence tests actually measure* 
Such «tipirical investigation is now referred to as construct validation* 

The test construction activities of Binet# experimental psychologists' 
examinations of the relationship of learning ability and intelligence^ and 
Boring's efforts to encourage psychologists to use operational definitions 
all represented attempts to define intelligence* However^ the systematic study 
of the nature of intelligence to determine its structure as well as its function 
became the province of primarily two types of theorists t those whose approach 
is through developmental or genetic investigation and those whose approach is 
through multivariate analysis* 



DEVELOPMENTAL APPROACH TO THE STUDY OF INTELLIGENCE 

Jean Piaget provided useful information on the characteristics of the 
successive stages of intellectiial developnent* His work is considered to be 
significant since it describes the way particular knowledge develops* in 
Piaget* s conception^ intelligence^ which is the extension of certain fundamental 
biological characteristics # can be divided into three aspects: content, function^ 
and structure (Flavell# 1963# chap* 1)* content encompasses the observable be- 
havior of the individual which the psychologist attempts to interpret (Guilford* 
1967* chap* 1)* Function refers to the principles of intellectual activity 
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oomnon to all ages (Guilford, 1967# chap. 1). Contained within the broad cate- 
gory of function are two principle processes^ assimilation aiid accommodation, 
which are responsible for the organism*s maintenance of equilibrium (Flavell^ 
1963)* Assimilation is the process of taking in information present in the 
environment. The information becomes part of the individual *s existing struc- 
ture of knowledge through accommodation/ which is the process of changing the 
individual *s structure of Knowledge in the light of the information being 
assimilated (Flavell, 1963, chap. 1). Both of these processes are continuous 
in individuals of all ages. Structure^ the third aspect of intelligence^ refers 
to concepts which develop and change with age and experience. Some of the con- 
cepts which have been investigated by Piaget include classes^ relations^ 
quantity/ number^ and conservation of quantity and space (Guilford, 1967# 
chap. 1). As children develop, their use of these concepts becomes more logical 
in a formal sense (inhelder & Piaget/ 1964) * flSie sequence of development which 
leads to the use of formal logic is hierarchical in nature, with each stage 
built ufon a previous stage and all of than occurring in an invariant order 
(Inhelder & Piaget, 1964) ^ 

This developmental sequence has several stages. Of particular interest 
are the stages of concrete operations and formal operations* The concrete 
stage, typical of children imder eight* is characterized by Plavell (1963) as 
entailing thought bound by events and objects of the real world, and involving 
little abstraction. Characteristic of adolescents and adults is the stage of 
foinnal operations, in which thought is no longer bound by externals but has 
become more internalized and logical. 

Piaget* s method is one of clinical observation* not rigorous experimenta- 
tion. The results of his work have provided psychology with a description of 
stages of intellectual development through which all individuals appear to 
pass* Tasks which have been constructed by Piaget to indicate an individual's 
stage of intellectual development (Guilford, 1967# chap. 7) are used to assess 
the availability and use of the concepts mentioned earlier^ 

Piaget has not been interested in the study of individual differences in 
intelligence per se. Hather# he l;as been interested in determining and 
characterizing the stages of intellectual development through which all indivi** 
duals pass. 

MULTIVARIATE APPROACH TO THE STUDY OF INTELLIGENCE 

The second approach to studying the fundamental nature of intelligence is 
represented by those theorists who use multivariate methodology as their 
primary tool for the investigation of the structure of intelligence. A long 
series of contributions have been produced by these theorists. In this review 
the work of each of the following multivariate theorists will be briefly considered: 

Spearman (1927), L. Thurstone (1935) # C. Burt (1949) # P. E. Vernon (1950)/ 
R. B. Cattell (1963), J. P. Guilford (1967), and H. E. Garrett (1946). 

Spearman (1927) was the first psychologist to use factor analysis in an 
attempt to e^^lain the structure of intelligence. His work led to the conclu- 
sion that intelligence is comfosed of two basic types of factors; a general 
factor "G** and a large number of specific factors which he referred to as "s" 
factors. In his twcfactor theory* intelligence is represented primarily by the 
*'G" fa-rtor in Vtitying amounts and Spearman (1927) believed it to be the most 
important aspect of intelligence measured by intelligence tests. "G,'* or general 
intelligence, is held to account for the substantial in tercor relations among 
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many intelligence tests, according to Spearman# because ^11 of these tests are 
measuring this same ability. The most important characteristic of "G" is that 
it requires insight into relationships. 

When Spearman was confronted with evidence of intelligence tests which 
were not highly correlated* his explanation was in terms of the **s,** or 
specific, factors which were held to be unique to each type of mental ability. 
An example of a specific or **s** factor was rote memory. In general the "s" 
factors did not involve insight into relationships. 

For Spearman, all mental activities had a common "G** factor which was the 
most important characteristic. In addition* each mental activity had its own 
specific ability or abilities. As Spearman continued his work* he recognized 
that a grou^ of mental tests share some variance in addition to that accounted 
for by **G.** He considered this additional variance to be due to what he called 
a ^*grou^ factor.** Sintie Spearman did not view group factors as significant* he 
did not actively investigate them. Intelligence tests, according to Spearman 
(1927), should be constructed to measure the **0" factor* and **s** factors should 
be minimised, thereby leaving **G" as the crucial measure of intelligence. 

Spearman^s two*factor theory was discounted by Thurstone (1938), who 
used a different factor**analytic procedure-*the centroid method of factor 
extractions — to examine the structure of intelligence, fie noted that often 
when tests are factor analyzed there is neither a universal "0** factor nor a 
large number of *'s** factors; rather there are several group factors. "Group 
factor theory**' which was Thurstone's contribution to the study cf intelligence* 
is based upon the intercor relations among limited numbers of tests, fie believed 
it to be the best theoretical base for studying and discussing intelligence 
(Thurstone, 1938) . 

Thurstone*s original work (1938) included the administration of 56 tests 
of mental abilities to a large number of adults. Through factor analytic 
procedures he accounted for performance on the 56 tests with seven basic 
factors. These seven basic factors represented mental abilities which Thurstone 
claimed were the primary components of any complex intellectual performance. 
There was not a high intercorrelation among the seven abilities, so he argued 
that no general intellectual factor existed. In time* Thurstone ^s position 
changed in that he found evidence to support a **second*order factor** which 
unites the primary group factors (Guilford* 1967* chap. 3) . 

Followers of Spearman held to his original notation of a **G** factor, but 
as time progressed and evidence supporting the existence of group factors 
increased* several of Spearman^s followers developed hierarchical models to 
explain the interrelationships among specific group and genera^ factors 
(Guilford* 1967* chap. 3). These models depict intelligence as neing very 
specialised. The two major hierarchical models reviewed will be those of 
Burt (1949) and Vernon (1950). 

Burt conceived of a hierarchy of mental abilities representing all of the 
human mind, with a factor corresponding to each mental abiJ ity differentiated 
at each level of the hierarchy. The human mind contains two general factors* 
*'G'* and "practical abilities.*' Successive dichotcmisations occur as the model 
moves from general factors to group factors, and finally to specific factors. 
As the model is presented* it departs from strict dichotomisations ^ince there 
are points at which a higher level ability contains more than two abilities at 
the next lower level of generality. Consider an example from the Burt models 
The entity of the human mind is divided into two abilities, **G*' and **practlcal 
abilities." "G** contains *'memory*' and **productive associations.** *'Memory,** 
in turn* contains several group factors labeled **visual,*' ''auditory,** **kinesthe- 
tic," and "verbal memory.** Each type of m«nory contains even more specific 
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mental abilities* Throughout the model, abilities at each successive level 
of generalityi^are labeled; Abilities resulting from the first division, "G" 
and "practical abilities," are referred to as "relations." Abilities at the 
second level of generality are called "associations," and third and fourth 
level abilities are labeled "perceptions" and "sensations" respectively 
(Guilford, 1967, chap* 3)* 

The Vernon (1950) model, also hierarchical, postulates "G" as the most 
important factor, Vernon maintains the existence of major group factors. 
In turn, each group factor contains more minor group factors, and b^ond these 
factors are very specific factors each having a narrow ;;cope and considered by 
Vernon to be trivial (Guilford, 1967, chap. 3). For Vernon, "G*' is dichotomized 
into *'v:ed" or verbal educational and "ksTij" or practical abilities. The *'v:ed" 
factor contains two minor factors; "verbal*' and "numerical." The "k:m" 
factor contains three abilities: **spatial ability," "manual ability," and 
**mechanical information.*' Beyond these are the veiry specific factors. 

The concept of "G" af developed by Spearman (192?) has been criticized 
by several theorists including Thurstone (1938) and Guilford (1967), who 
have pointed out that its characteristics, rather than being invariant, ar& 
entirely dependent on the test batteiry being used. *'G" is not invariant. 
One of the theorists who moved away from the notion of "G*' was R. 'lattell. 

Cattell (1963) developed a theoiry of intelligence which has two factors t 
"fluid" and "crystallized.'* The fluid factor represents an innate ability 
which requires abstract reasoning but little specific information. Tasks 
requiring fluid ability necessitate the reorganization of knowledge (Cronbach, 
1970, chap. 9). The cirystallized factor represents acquired information. 
Obviously, fluid intelligence remains relatively constant across time with 
possibly some decline in old age. Cirystallized abiliti^, on the other hand, 
increase with age. 

For Cattell (1963) the notion of fluid ability is intimately associated 
with culture-fair intelligence tests. Tasks requiring crystallized ability, 
on the other hand, use information and skills which are the direct result of 
instruction and are culture-bound, 

Guilford (1967), after conductii^g extensive research, became disenchanted 
with the hierarchical models which had evolved from earlier theories of intel* 
ligence. Research had revealed the existence of many different intellectual 
factors, and conflicting evidence surrounded "G." Guilford (1967) concluded 
that even the hierarchical models could not adequately reflect the ^structure 
of intellect, and he turned to a morphological mod^T. This model is a cross-* 
classification of intellectual phenomena with intersecting categories rather 
than nested ones. Guilford's model employs three independent dimensions: 
content, operation, and product. Any mental ability represents one category 
in each dimension, resulting in a total of 120 possible intellectu^? abilities* 
An intellectual factor results when any one of the five types of o]^' nation 
combines with any of the six types of product and any one of four types of 
content. The content, operatioTw and product dimensions are briefly described 
below. 

The content dimension is an extension of the distinction between verbal 
and nonverbal abilities. The four content categories classify the type of 
input which is processed. The operation dimension provides five categories 
of types of processing to be applied to the various types of content. The 
classification of factors according to product describes the form of the 
information which is to be processed. Which one of the six product categories 
is us^d is determined by the granularity of the input and the types of inter- 
relationships existing in the input. 
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Each of the theories reviewed represents one of the two systematic 
approaches to the study of the nature of intelligence. Garrett (1946) # 
however, represented a combination ol the genetic and multivariate approaches. 
He performed factor analyses on scores from a battery of various intellectual 
tasks administered to children of different ages* Garrett^s factor analyses 
yielded different factors fox the various age levels* He concluded that as 
children mature, mental abilities become vaore differentiated* 

This brief review of the contributions provided by the genetic and 
multivariate approaches provides some perspe^^tive for reviewing the more 
recent theory of intelligence developed by i^rthur Jensen (1969)* Jensen's 
approach to intelligence reflects both the multivariate tradition and the 
experimental approach, which regards learning ability as equivalent to intelli- 
gence * 

In developing his model of intelligence Jensen drew heavily from the work 
of factor analysts for his definition of Level II intelligence, or conceptual 
ability, which can be viewed as somewhat analogous to Spearman's "G*" In 
developing the argument to support Level I Intelligence, or rote mento.\ , Jensen 
relied upon the tradition of experimental j^ychology which historically has 
examined learning ability as a unitary factor independent of content* Jensen 
contends that the two types of abilities^ Level I and Level II intelligence, 
are hierarchically dependent with Level II processes necessitating the memory 
abilities which are part of Level I* The notion of hierarchical dependence 
between abilities was contributed by Burt {1949) and Vernon (1950) * White 
(1965), an American learning theorist who used the experimental method, also 
influenced Jensen with his theory of hierarchical arrangement of learning 
processes* 

THEORETICAL BASIS FOR THE DISTINCTNESS OF 
MEMORY FROM CONCEPTUAL THOUGHT PROCESSES 



Definitions and CharacterisLics of 
Level I and Level II Intelligence 

Since Jensen is the most recent theorist to posit a menory factor distinct 
from higher thought processes, his terminology is adopted in the following 
discussion* Jensen's (1969) theory posits two types of intelligence* Level I 
intelligence, originally referred to by Jensen (1969) as "basic learning 
ability," is the capacity to receive or register stimuli^ store them, and later 
recall or recognize the material accurately {i*e*, rote memory)- Level I is 
characterized by *'the lack of any need for elaboration, transformation, or 
manipulation of the input in order to arrive at the output [Jensen, 1970c, 
p, 4)," The learner need not refer to past learning* Forward di9it span is 
one of the clearest measures of Level I intelligence, whereas reverse digit 
Span is not as pure a measure since transformation of input is required prior 
to output* Serial rote learning and paired associate learning are also 
examples of Level I ability* Level I intelligence (Jensen, 1969) is the source 
of most individual differences on tasks requiring little transformation of 
input. 

Level II intelligence is characterized by transformation and manipulation 
of the stimulus prior to making the response (Jensen, 1969)* Jensen stated 
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that Level ll intelligence is the set of mechanisms ^ich make possible generali- 
zation beyond primary stimulus generalization, as well as concept formation, 
encoding and decoding of stimuli in terras of past experience, relating new 
learning to old learning and transfer of concepts and principles (Jensen, 
1969). We >shall regard Level II as ii.cluding all higher mental processes* 
Spearman's "G," defined as ^'education of relations and correlates," (Spearman, 
1927) would correspond to Level II (Jensen, 1970c) • Most standard intelligence 
tests, especially those such as Raven's CPM which are view*?d as culture-f air , 
would depend heavily upon Level II (Jensen, 1970c) . Few tests assess Level I 
or Level II intelligence in a pure form* Any actual test measures a mixture 
of these two types of abilities. 



Task Sampling as a Method of Establishing Validity 

of the Constructs of Level I and Level ii Intelligence 

A research procedure referred to as "task sampling" has been employed 
as a means of determining whether Level I and Level II intelligence exist. 
For this purpose, task sampling involves testing the some group of children 
on several operationally defined measures of Level I and Le\"el II intelligence* 
Ideally, these measures should be selected such that they elicit either Level I 
or Level II intelligence exclusively* The tasks nay have been used previously 
in Jensen's studies of Level I and Level II intelligence, or they ittay be new 
tasks which meet Jensen's criteria for Level I or Level II tasks* 

Stevenson's work is noteworthy in that he uses a number of task3 other 
than those used by Jensen to test Level I and Level II intelligence* Friedrichs, 
Hertz, Moynahan, et al* (1971) studied the interrelations and correlates of 
learning tasks ai- the preschool level for a group of 50 middle class children* 
Stevenson, VJilliams, and Coleman (1971) exaniined the in rrelations among 
eight learning and eight performance tasks in four and five year old disadvantaged 
children. The results of the studies when examined together ^ave little support 
to Jensen's position of differences in the intellectual abilities of middle 
and lower class children. The in tercor relations of the learning tasks were 
very similar for both social classes. The various operationalizations of 
Level I intelligence were significantly correlated, and a significant correla- 
tion between PA learning and category sorting, representing a significant 
initercorr elation between Level I and Level II intelligence, was also found* 
This finding would not be v^^edicted by Jensen (1969) for lower class children. 
The only performance task, i.e*, a task measuring a personality or attitudinal 
attribute relevant to success in scholastic situations, with a high frequency 
of significant correlations with the operationalizations of Level I and Level ll 
intelligence was "following instinictions. " This suggests that the instructions, 
an aspect of the method of measuring the trait, rather than the content of the 
tasks themselves, may have introduced variance into the children's performance* 

The two studies cited above are valuable contributions to the literature 
on Jensen's theory. Most ijnportantly, they sample several tasks which ideally 
should elicit Level I or Level II intelligence* Results of the two studies 
cannot have maximum impact, however, since at the pres^^hool age Level I and 
Level II differences between social classes would not yet h^ive become prominent, 
Jensen (1969) explicitly states that Level II abilities are slow to develop 
and reach full development between the ages of four and six* SES differences 
in older children need to be examined using a variety of Level I and Level II 
tasks* 
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The high frequency of intercorrelations found between following instruc- 
tions and learning tasks indicates the need for a systeinatiic study of the 
type described by Cambell and Piske (1959) in which the method of measuring 
a trait is examined through the use of iitultitrait*>multiinethod matrices* This 
methOQ is one of several approaches to construct validation* 

THE SYSTEMATIC EXAMINATION OF HYPOTHETICAL CONSTRUCTS 

The criticisms of Priedrichs et al, (1971) and Stevenson et al. (1971) 
raise some doubts as to whether Level I sund Level II intelligence exist as 
coherent psychological traits* Task san^ling methods failed to reveal the 
expected SES differences among preschool children and evidence suggested that 
the method by which the traits were being measured might be introducing con- 
siderable variance into obtained scores (Friedrichs et al,, 1971; Stevenson 
et al*, 1971) * 

Cambell and FisXe (1959) stated that in ai^ attempt to measure a psycho- 
logical trait, some aspects of the instrument employed are introduced to speci* 
fically represent the trait which is to be measured, while other features are 
intrinsic to the particular method employed* The contribution of method 
variance limits the validity of obtained scores* Campbell and Fisk^i's (1959) 
multitraitHonultimethod matrices provided a means of examining tV*d contribution 
of method variance to test scores* This technique could be ^nloyed to syste* 
matically examine method variance in various tests designed to elicit Level I 
and Level II intelligence* Cronbach and Meehl (1955) provided direction for 
the clarification of constructs by examining patterns of correlation and co* 
efficients* 

In defining a construct, Cronbach and Meehl (1955) stated the following 
characteristics; (a) A construct is a postulated attribute and (b) it is 
assumed to be reflected in test performance* **A construct has certain asso* 
ciated meanings carried in statements of the general character; Persons who 
possess this attribute will in situation X act in manner Y (with a stated 
probability) {Cronbach 6 Meehl, 1955, p* 

Iliere are several methods which can be used in the investigation of con- 
struct validity. A list of methods suggested by Cronbach and fjeehl (1955) 
follows: 

1* Use of groi^ differences to test constructs* 
2* Correlation matrices and factor analysis* 

3. Studies of internal stjnicture (item-test correlations)* 

4. Studies of process (observation of influences which invalidate 
the test-taking activity) . 

Construct validation is l.he process of confirming or rejer^ting the ten- 
ability of a construct which may not be directly observable by testing the 
hypotheses it gives rise t*)* If the hypotheses are confirmed the belief in 
the construct can be retained. If the hypotheses are not confirmed then there 
are three alternatives open to the investigator; (l) the opera tionalizat ions 
may be inappropriate, (2) the theory may be inaccurate, or (3) the experi- 
mental design may have failed to test the appropriate hypotheses {Cronbach 6 
Meehl. 1955)^ 
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An additional method to be used in the study o£ construct validity was 
developed by Campbell and Fiske (1959)* They assessed convergent and dis* 
crijninant validity of constructs through the use of correlation matrices, 
which are referred to as multitrait-multimethod matrices, they were developed 
to permit the systonatic examination of method variance in tests* 

It seems that a cc»nbination of such construct validity methods could be 
useful in helping to answer the question of whether the constructs of Level I 
and Level II intelligence exist as coherent psychological traits* 



SUMMARY 



Following Spencer's introduction of the conc^t of intelligence to the 
psychological ccmmunityi numerous intelligence tests were developed with 
little concern for the nature of intelligence itself* To facilitate communica* 
tion among psychologists, ar\d to permit conparisons of the results of studies 
using various intelligence tests, pressure arose among psychologists to reach 
a common definition of the construct "intelligence*" Definitions of intelli* 
gence were often developed in response to practical needs, but the systematic 
study of the nature of intelligence was carried out by two major groups of 
theorists: those onploying the genetic approach to intelligence atnd those 
relying primarily on multivariate methodologies* Jensen's twfactor theory 
drew from the multivariate tradition as well as one borrowed from experimental 
psychology which regards learning ability as equivalent to intelligence* 

Jensen (1969) is the: inost recent proponent of two basic types of intelli* 
gence, which he labeled Level I (associative learning ability) and Level II 
(conceptual learning ability)* The terminology of Jensen's theory will be used 
in this study, which seeks to clarify the relationship of memory to higher 
mental processes* 

Dt^irical findings on which Jensen's theory is based, as well as sub* 
sequent research generated by the theory, have employed essentially four types 
of statistical methodology i correlation, regression, factor analysis, and 
analysis of variance* Only a few studies, however, have used measures of 
Level I and Level II intelligence other than those originally a^ployed by 
Jensen* Most of these studies used only one measure of each proposed type of 
intelligence, suggesting the possibility of artifacts arising from "single 
operationalism (Underwood, 1957)*'* In many of the studies race and SSS viere 
confo'inded* The results which Stevenson (Friedrichs et al., 1971; Stevenson 
et al* , 1971) obtained yAien using several new operationalizations of the 
Level I and Level II constructs were not in agreement with certain predictions 
of Jensen's theory* Results of these studies did not have maximum impact, 
however, since the sample used was of preschool age, and according to Jensen's 
(1969) theory, Xievel IX abilities reach full develofMttent between the ages of 
four and six. 
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HETHODOLOGY 



SUBJECTS 

All fifth grade white children in one Wisconsin public school district 
vhose parents consented to their participation in the research vere tested* 
Of the 273 children in the fifth grade, 221 or 31 percent were permitted 
by parental consent to paurticipate in the study. A large sample of children 
were tested in order to avoid attenuation of the range of IQ and scholastic 
achievement scores^ and to assure the stability of the matrix of intercorrela* 
tions. Since parental approval for all children to participate was not ob- 
tained, the participating children may not be regarded strictly as a ^epre- 
sentative saii^le of fifth grade school populations. The treatment of all 
participants was in accordance with the American Psychological Association's 
Ethical Principles in the Conduct of Research with Htanan Participants (1973) . 
No prizes or material awards were provided e,^.ther during or after the testing. 

Several measures of Level I and Level II intelligence were administered 
to each child in the sample. Table 1 presents ttie mean and range of IQ 
using the Peabody Picture Vocabulary Test (PPVT) and achievement scores for 
the sample. Some of the instruments administered were standardised. Other 
instnrsents adotinistered were; measures constructed specifically for use 
in this research^ learning tasks typically employed in laboratory experi* 
ments^ and standardized instruments fc^ which a nonstandard administration 
procedure was employed, lae results of the pilot tests and detailed des- 
criptions of these instruments are provided below. 

In the follcDwing sections ^ each proposed operational izat ion of Level I 
and Level II intelligence is presented. Information concerning the relia* 
bility of each measure and the rationale for its selection in the light of the 
following definitions of Level I and Level II intelligence are given. 

Level I ability is essentially the capacity to receive or register 
stimuli^ to store it, and to later recognize or recall the material 
with a high degree of fidelity. ... It is characterized especially 
by the lack^f any need for elaboration^ transformation^ or manipu- 
lation of the input in order to arrive at the output. flSie^Jjiput 
need not be referred or related to other past learning in order 
to issue in effective output. . . . Reception and reproduction of 
the input with high fidelity is all that is required fJensen^ 
1970c, p. 4]. 
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TABLE 1 

MEAN AND RANGE OF IQ AND SCHOLASTIC 
AOIIEVEMENT SCORES FOR THE SAMPLE 



Test 


Sample 

X 


Range 


<^ 

Peabody Picture Vocabulary Test IQ 


113.70 


80-145 


Science Research Associates Skills 
Profile Math Concepts 


26.11 


7-37 


Science Research Associates Skills 
Profile Math Computation 


18.30 


3-24 


Gates-MacGinitie Vocabulary 


28.02 


6-41 


Gates-MacGinitie Comprehension 


31.35 


5-50 



Level II ability * * * is characterized by trans fomnat ion and 
manipulation of the stimulus prior to maXing the response* It 
is the set of mechanisms which make generalization beyond primary 
stimulus generalization possible* Semantic generalization and 
concept formation depend upon Level II ability: Encoding and 
decoding of stimuli in terms of past experience^ relating new 
learning to old learning, transfer in terms of concepts and 
principles are all examples of Level II [Jensen, 1970c, p* 43* 

In addition, information used to classify each measure for inclusion in 
Several multitrait-multimethod matrices is provided* The discussion of these 
matrices is reserved for Chapter IV* 

0PERATI0NALI2ATI0NS OF LEVEL I 
Digit Span 

The f'^rvard portion of the digit Ri>an subtest from the Wechsler Intelli- 
genco Scale for Children — Revised (WISC-R) was used* This is an individually 
administered Vf^rbal subtest and requires only the registration, storage, and 
recalling of digits without transformation (Jensen, 1970c) • Jensen (1970c) 
defines digit span forward as a nearly pure measure of Level I- Reverse 
digit span requires a transformation of input prior tc output, and is regarded 
as a less pure form of Level I ability. 

Test-retest reliability of the entire digit span task, as reported in 
the WISC-R manual (Wechsler, 1974), is approximately .71 for children aged 
10 1/2 years. The correlation between the forward portions of the digit span 
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subtests of the Stanfoxd^Binet Intelligence Test a^i thA laSC-R was calculated 
within each of two levels of S£S (Jensen, 1970b) * Vhs correlation between 
the two tests of digit span forward for the low SES group was *49 and for the 
middlft SES group was *62* It should be no'ted that Jensen adninlstered these 
two subtests together, interspersing items in order of increasing difficulty* 
Only two measures entered into these correlations^ the longest series a child 
got correct on the Stanford-Binet Intelligence Test versus the longest series 
correct on the tfiSC^R* Utese correlations represent an attempt to measure the 
reliability of digit span forward based on a single measure* The reliabilities 
of the average of the two spans were *65 for low SES and *76 for middle SES* 
Therefore, digit span tasks appear to be reliable ^en the dependent variable 
is the longest series recalled correctly* 



Coding B 

Coding B is an individually administered nonverbal subtest frcm the 
WISC-R requiring a child to match and a>py synibolB in blank spaces provided 
on the test sheet using a guide of digits associated with siiple shapes* 
Since children must write the associated symbol, the test uses a free response 
foimat* The reason for choosing Coding B and a Level X task is that it is 
based on the children's learning to ccotbine digits and shapes and then to re- 
produce these combinations with paper and pencil* There is no trans forsiat ion 
of input prior to output* Glasser and Zimerman (1967) claijn that the ability 
being measured on the coding subtest is the capacity to absorb new material 
presented in an associative context* 

Test-retest reliability of the coding subtest has been established as 
*76 for children aged 10 1/2 years (Wechsler, 1974)* 

In this study, the Coding B subtest was administered to classroom-sized 
groups rather than individuals because tasks were needed which could be 
classified in the multitrait^multimethod matrices as Level I tests ^ich are 
group administered* To assess the effects of this nonstandard adninistration, 
a pilot test was conducted to establish the correlation between an individual's 
score when the subtest is group administered and his score ^^len the subtest 
is administered individually* The verbatim instructions used for the group 
adninistration are given in Appendix A* 

Fdr the Coding B pilot the design used was a two-by*two factorial model 
with repeated measmres on the second factor* Children were randomly assigned 
to two groups; one group received .first the individual, then the group adminis- 
tration, the second was given the group administration first* The second 
administration for both groups was given one wedk after the first administra- 
tion* The pooled within^roup correlation between individual and group ad- 
ministrations was moderately high, £ « ^77, N = 31* A significant practice 
effect, Txjit (^*^^^ " 55*426, £ < *001, may have reduced the magnitude of 
the correlation coefficient* 



Uncategorized Free Recall 

^^categorized free recall is an experimental technique which has been 
used to test Level I intelligence (Jensen & Frederiksen, 1973) * The technique 
consists of showing each child 20 familiar and unrelated objects one at a 
time, and after all the objects have been presented asking the child to 
recall as mai^ of them as he can* Bach object is presented for approximately 
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two seconds and the child must name each one when it is presented* If the 
child is unable to name an object, the examiner will supply a name* The 
child then has 90 seconds to recall as inany of the objects as he can* This 
procedure is repeated for each of four trials* For each trials. .however* 
the objects are presented in a different predetermined random order* The 
same four randcm orders are used for all children* The verbatim instruc- 
tions to the child are included in Appendix A* 

The list of objects used in this task was as follows; 'ball# bell# 
book# box# brush# car# cat# coat, couch# egg, flag, frog, gun, key, pen# 
salt shaker, spool of threads train# watch, and wheel* These objects were 
selected to replicate as closely as possible the stimulus materials used by 
Jensen and Prederiksen (1973)* Since both uncategorized and categorized 
tasks were presented to each child# substitutions were made for 15 percent 
(three) of the objects to eliminate duplications which occurred in Jensen 
and Frederiksen's original uncategorized and categorized tasks* 

The objects used w^e not readily grouped into categories^ and their 
recall was more likely to involve rote learning than Level II processes; 
Jensen and Prederiksen (1973) indicated that it is unlikely that a schools- 
age child would en^loy Level XX processes in perfoming this task* Un- 
categorized ffee recall is classified as a verbal task for the purposes of 
the multitrait-^multimethod matrices*' 

There is no established reliability on the uncategorized free recall 
task used by Jensen and Frederiksen (1973)* Therefore^ a pilot study was 
conducted to determine the test-retest reliability of the task* Two admin- 
istrations two weeks apart were given to each of 28 fifth grade children^ 
and test'^retest reliabilities were obtained for three variables; the sum of 
the nuiriber of objects recalled on each of the four trials (total amount re- 
called)* the index of subjective organization across trials 3 and 4 (^34), 
and the mean index of subjective organization for trials 1-2, 2-3, and 3-4 
( SOa vg) (Tulving, 1962)* The reliability of total amount recalled was *41, 
the reliability of SO^ ^ was -*10 and the reliability of the SOavg measure 
was -*07* 

Xn Jensen and Frederiksen (1973), the dependent measures used were 
number of objects recalled for each of the four trials* Total amount re- 
called is a more appropriate measure for the present study because no dif- 
ferential predictions concerning performance across trials have been made, 
and sensitive tests of group differences on this single task are not re- 
quired* 

"The so provides for a measure of sequential redundancy in repeated 
ordered samples of a set of items* * . * Xt is simply a measure of actual 
organization relative to the maximum [Tulving, 1962, pp* 345# 34?]*** In 
other words# ^ evaluates a child's tendency to recall it^s in the same 
order on successive trials, in the absence of any experimentally manipulated 
sequential organization among the stimulus items (Mandler, 1967)* 

On the ba^is of the pilot test results^ the only variable used in this 
study was total amount recalled* Ihe lack of reproducibility in the SO in7 
dices supports Jensen and Frederiksen's (1973) classification of uncategorized 
free recall as a Level I task* although it i« possible that stable pairwise 
clusters would develop if more trials of the task were administered* The 
podr reliability of total amount recalled in the pilot test may have been 
due in part to a significant practice effect, ^(27) 7*326# £ < *001# and 
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to the testing conditions* The categorized and uncategorieed free recall 
tasks were piloted with the same children # in two sittings, with relatively 
little inteirvening activity^ and some interference was evident to the 
examiners * 



Paired-Associate Task 

The paired'^associate task (PA) used included eight pictorial PAs. The 
PAs were presented on 5 x 8 inch index cards* The pictures used# as well as 
the verbatim instructions read to each child# are included in Appendix A* 
Each picture is of a familiar objects but the pairs of objects are not 
typically associated* Each child was tested individually* The task required 
verbal responses from the children* A practice task consisting of one pairing 
and one test trial using three san^le pairs was administered* The practice 
test was followed by the presentation of the pairing trial of the 8-item PA 
list* The pairs of pictures were administered at ^a rate of one pair of 
pictures every five seconds* Only one pairing trial was administered, followed 
by a test trial whinh was self paced* 

A PA task can be defined as Level X if the pairings of elements are not 
meaningful; in other words, if the elements are not typically associated 
(jensen# 1970c)* Furthermore, for this task children were not instructed to 
label the pictures as they were presented^ thus further decreasing the likeli- 
hood of their engaging in verbal elaboration or other XiBvel II processes* 

A pilot study was conducted to determine the test-retest reliability of 
this task* The task was administered twice to 21 children^ with an inteirval 
of two weeks between administrations* Based upon experience gained in the 
course of this pilot the task was shortened frcni 10 to 8 pairs of pictures* 
As a result, only seven subjects received exactly the form administered in the 
major study* The test-pretest reliability of the lO-^pair task was *54, N » 21* 
The dependent variable used was number of correct responses* A significant 
practice effects t^{20) = 3*01# £ < *005# may have served to reduce the correla- 
tion* 

Hohwer, Amnon, SuzuJci# and Levin (1970) obtained average test-pretest 
reliabilities of *40# *54# and *56 for kindergarten, firsts and third grade 
children respectively, using parallel forms of a PA task consisting of five 
pairs of pictures with no verbal labeling* Each of these three correlations 
is the average of the obtained reliabilities for each of two groups of 48 
children^ one of low SES black children and one of middle SES white children* 

The test*retest reliabilil^ for the 10-pair PA task piloted was in the 
same range as those reported by Rohwer et al* (1970) * The decision to use 
the 9-pair task was made on the basis of the poor performance of fifth grade 
children on the 10-pair task and the degree of frustration observed in most 
children during the administration* Over half the children gave only one or 
two correct responses^ and only one child obtained a score of over 50 percent 
correct* 

On the first trial of a 10-pair PA task the mean number of correct 
responses should be fairly low for the follcving reason* Miller (1956) 
suggested that the ''magical number*' of 7 +^ 2 parameteriees the limits of 
memory* Miller stated the relationship between memory limits and the re- 
coding of information in his utilieation hypothesis, which holds that people 
usually can remember only about seven items from an input list in immediate 
memory* It is only through reooding or reorganieing items that more informa- 
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tion can be rem&inbered* Miller's results suggest that the recall of more than 
nine items would imply some reorganization of information^ i.e*# the applica-^ 
tion of Level II intelligence* Since only one trial was administered in the 
task under discussion^ there is not opportunity for the reorganization of in-^ 
formation needed to recall more pairs* Only one trial was administered to 
obtain as pure a measure of Level I intelligence as possible, since the pro-- 
bability of the reorganization of the information by verbal and imaginal 
elaboration would increase on successive trials* 

The use of the 10-item PA list would have been likely to frustrate 
children and increase the likelihood of receding or other Level ii processes 
being employed. The 8-pair task# although piloted on only seven children^ 
appeared to be less frustrating* On the basis of Rohwer's reliabilities on 
the 5-pair PA task and the obtained results of the pilot of^the lO-pair PA 
task, it was expected that the reliability of the 8-pair task would be com- 
parable . 



Visual Memory for Symbols 

This nonverbal test* which was group administered, was constructed speci- 
fically for use in this research* It made use of symbols similar to those used 
in tests of visual sequential memory* A placard showing a row of symbols was 
presented for five seconds* the children were then asked to select the series 
presented from among four alternates, the three dietractors being various arrange- 
ments of the same symbols. Wo verbalization was required from the child* 

Seven items were administered, and each of the seven placards was pre- 
sented for only five seconds* Items increased in difficulty starting with a 
row of only three symbols arid cbhtihhihg with two items each of six, seven, 
and eight symbols* 

The test was classified as measuring Level I intelligence since it did 
not require the input to be transformed prior to output* Since Jensen never 
tested for Level I in the visual modality (Jensen# 1973) # this measure gave 
sane indication of the validity of the Level I construct across sensory modalities. 

A pilot tost was conducted to establish the test-retest reliability of 
this instrument* The two administrations were conducted over a time span of 18 
days* The results of the pilot indicated a fairly low correlation^ £ = *48, 
N = 30* Due to the poor performances on three of the seven items they were 
dropped from the test, so the test^retest reliability above represents a 4-item 
test* Various forms of this test were piloted* In each of three pilots, items 
were dropped due to either a lack of variance or lack of discrimination* 

Although the test-retest relieO:>ility of *48 would be judged inadequate by 
many psychometricians, an argument can be made regarding the conditions 
surrounding a test-*retest design and performance when rapid presentation of 
stimuli is employed* Since stimuli are exposed for only five seconds the 
opportunity for environmental distractions to interfere with children's per- 
formance is great* Since the visual memory task was so sensitive to external 
conditions during administrations # every effort was made to minimize such dis- 
tractions during the actual study* Hbwever# it was evident to the test adminis- 
trators that this attempt was largely ;insuccessful, and the test results were 
not used in the analysis of the data. Verbatim instructions used will not be 
provided here, since results from this test were not included in any analyses. 
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OPERATIONALIZATIONS OF LEVa II 

All of the ope rationalizations of Level II intelligence can he classified 
as either fluid or crystallized intelligence, abibreviated "2f** ^'Sc** 
spectively, corresponding to Cattell^s two aspects of general intelligence 
(Jensen, 1973)* Jensen entployed Cattell's definitions of fluid and crystal- 
lized abilities in discussing the results of a factor ar«dlytic stu^y \^ich he 
conducted (Jensen, 1973) * Follo»ring Jensen^s usage, the operational izat ions 
of Level II included in the present research are also classified as corres* 
ponding to either fluid or crystallized abilities* 

OPERATIOKALIZATIONS OF LEVEL II FLUID irfTELLIGEKCE 

Fluid intelligence is required for pure abstract reasoning* Fluid tasks 
require analysis and reasoning, and specific knowledge is seldom helpful* 
^e skills and aptitudes employed in such tasks are not the products of direct 
training; they involve the reorganization of knowledge rather than the use of 
skills directly taught (Cronbach, 1970, chap* 9)* 

Raven*s Coloured Progressive Matrices (CPM) 

Raven* s CPM cannot be solved by sintple associative processes and is there* 
fore classified as a Level II test (Jensen, 1969)* l!he solution of the matrices 
calls for o^plex inductive reasoning strategies (Jensen, 1970c} * ^e CPM was 
constructed to load heavily on the "G" factor in the Speannaui sense# and on 
no other ability factors (Jensen, 1969)* The test-retest reliability for 
children nine years of age is reported in the test manual ^ *80 ^ *05 (Haven, 
1965)* In this study, the test was groxip administered and for the purposes of 
the multitrait-multimethod matrices it was classified as a nonverbal instrunent* 



Block Design 

Block Design is an individually administered subtest frooi the WXSC-R* it 
consists of 11 two-dimensional designs which must be reproduced with multi- 
colored blocks within a time limit* Bonus points are awarded for rapid per- 
formance* Kohs (1923) was the first to use copying two-dimensional designs with 
colored blocks as a nonverbal measure of intelligence* Various descriptions 
of the abilities and/or processes required for the solution of the block 
design subtest from the WISC-R support its classification as a measure of 
Level XX intelligence: the task requires analysis, synthesis and reproduction 
of an abstract pattern, and implicit verbal manipulation (Glasser £ Simmexroan, 
1967); the ability to reproduce spatial relations involves logic and reasoning 
(Wechsler, 1949)* 

The moderately high correlation of block design with the WISC-R full 
scale IQ, r^ = *65 (wecfasler, 1974) also provides support for its classifica* 
tion as a Level XX task* Since block design is a performance task requiring 
no overt verbalization by the child, it was additionally classified as a non* 
verbal task for the purposes of a multitrait-multimethod matrix* 

The test-retest reliability of the block design subtest for 10 1/2 to 11 1/2 
year old children is ,85 (wechsler, 1974)* 
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Categorized Free Recall 

The categorized free recall task differs from the uncategorized free 
recall task only in tl^^t a different set of 20 objects is en^loyed. The ad- 
ministration procedure and instructions to children were the same for both 
free recall tasks; the verbatim instructions are included in Appendix A* Ihe 
objects used in this task can be grouped into four conceptual categories > 
animals, clothing, furniture^ and tableware* list of objects by cate- 

gories follows: chicken, cow, dog, horse# mouse (anijoals): dress# hat# pants# 
shoe, skirt (clothing) j bed# chair# lamp# sink# table (furniture); and cup, 
glass# knife# plate, spoon (tableware)* Ihese objects were selected to repli- 
cate as closely as possible the stimulus materials used by Jensen and Frederiksen 
(1973)* The only substitutions were of pants for coat# since coat was used in 
the uncategorized list, and of sink for dresser, since no suitable dresser could 
be found* 

Jensen and Frederiksen (1973) state that Level II intelligence may facili- 
tate recall of a set of objects which can be easily categorized^ even though 
it is unlikely that Level II intelligence will be an important determinant of 
the performance of school age children on the uncategorized free recall task* 
Since organizing the objects into categories is a conceptual activity^ cate- 
gorized free recall was classified as a Level II task* 

There is no established reliability for the categorized free recall 
task used by Jensen and Frederiksen (1973), so a pilot was conducted to 
determine the test*retest reliability of the task* Two administrations were 
given two weeks apart to each of 28 fifth grade children^ and the test-retest 
reliability was obtained for the clustering index# devised by Frankel and 
Cole (1971), averaged over the four trials* Ihe reliability of the average of 
the Z index scores over the four trials was .74, N 28* 

In Jensen and Frederiksen (1973) the dependent :;^asures used were number 
of objects recalled and Z for each trial* The clustering index should pro* 
vide a purer measure of Level II intelligence than toted amoun}: recalled^ as 
it minimize.^ the effect of rote memory* The average Z index atross the four 
trials was deemed a more appropriate measure for the present study because 
no differentia] predictions concerning performance across trials had been made, 
and sensitive tests of group differences on this single task were not required. 

Frankel and Cole's index is based on the number of runs of Itms from 
the same category which occur in a recall list (0|^) * fhe mean (M^) and variance 
(V^) of the number of runs in a randomly selected list of the same category 
comfposition as the observed list are computed and a score is calculated: 
Z = (0|^ - My)/(Vy)V2, Clustering is defined as the presence of significantly 
*^too few** runs (Frankel & Cole, 1971)* 

A weakness of the index is its inability to detect the use of categories 
other than those the experimenter has established* However, it is superior to 
TUlving's (1962) index of subjective organization since only a subjective 
organization measure capable of reflecting bidirectional connections summed 
over several intervening items would be sensitive to the use of large category 
clusters (Cole/ Frankel, & Sharp, 1971)* 

Olhe categorized free recall task was classified as an individually admin* 
istered verbal measure of Level II intelligence. 



Simil arities 

Similarities is a verbal subtest of the WISC-R which estimates the range 
of an individual's ability to discriminate likenesses or make use of classifica- 
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tory relationships (Glasser $ Zirtnierman, 1967)* ^is subtest calls into opera^- 
tion past learning experiences, ability to comprehend, and capacity for associa* 
tive thinking, as well as the child's ability to select and verbalize appropriate 
relationships between two dissimilar objects or concepts (Glaeser £ Zimmerman, 
ld67) . Bialer (1968) states that there is a positive relationship between the 
ability to acquire secondary generalizations and XQ. Performance on the 
similarities subtest requires the ability to make suc^ secondary generaliza- 
tions, which are clearly ctefined by Jensen (1969) as necessitating Level XX 
intelligence* 

Test-retest reliability of the similarities subtest is ,81 for children 
10 1/2 years old as reported in the WISC*R manual (Wechsler, 1974). For use 
in the multitrait-multimethod matrices, this task was considered an indivi- 
dually administered verbal test* 



OPERATIONALIZATIONS OF LEVEL II CRYSTALLIZED INTELLIGENCE 

Crystallized intelligence is required by tests of information or fan^iliar 
skills* Such tasks require little reasoning; a bright but uninformed person 
would do poorly on tasks of this nature* Houtine application of rules, rapid 
computation, paragraph reading and table reading are examples of the use of 
crystallized intelligence* Transfer is required in performing these tasks, 
but there is little demand for ingenuity (Cronbach, 1970, chap* 9)* 



Peabody Picture Vocabulary Test 

*fhe PPVT consists of 150 sets of four pictures* 'fhe examiner says a 
word and the child must select the picture ^ich best tells the meaning 
the word* Items are administered until a basal and ceiling are established* 
This task was classified for the purposes of the multitrait-multimethod matrices 
as a verbal test whidi was given individually* 

The PPVT is designed to provide an estimate of a child*s verbal intelligence 
through the measurement of his receptive vocabulary (Dunn, 1965)* Verbal in- 
telligence as measured by the PPVT would be considered a Level XI process and 
has been used as such by Rohwer (1970) and Jensen (1970a) * Both researchers 
view the PPVT as more culturally biased than the CPM, but both measures are 
considered to be operationalizations of Level tX ability* Ihe process by 
which children abstract from a spoken word the salient attributes to be searched 
for among the pictures requires Level XX intelligence*^ 

The test-retest reliability of the PPVT as reported in its manual (Dunn, 
1965) was established using alternate forms of the test administered approximately 
three to seven days apart* For children 10 years old, the test-retest reliability 
was *77, u « 319* 



DSU Rhyming Task 

Ihis task was suggested by Guilford (1967, chap* 6) as a measure of diver- 
gent production of symbolic units (DSU,), as described in his ''structure of 
intellect" model* Children are giwn one minute to write down as many words 
as prasible that rhyme with the word **cat*** Verbatim instructions are included 
in Appendix A* llie lists of responses produced are idiosyncratic; no explicit 
set of rules or processes guide children to correct answers* This task re* 
quires Level II intelligence, since transformations of the input word must be 
made in order to generate a list of rhymes* 
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h pilot was conducted to determine the reliability of the task* Two 
group administrations wexe conducted one week apart, and the test-^retest re- 
^ liability wats computed for measures of fluency and originality* The fluency 
score was simply the number of rhyming words produced* The originality 
scores were calculated by tabulating occurrences of each rhyming word pro- 
duced across both administrations* Any word occurring on o^er 50 percent of 
the protocols was weighted 1, words occurring on more than 10 percent but 
less than SO percent of the protocols were weighted 2, and words occurring on 
10 percent or less of the protocols received a weight of 3* Heights assigned 
to each rhyming word on each protocol were averaged to obtain the originality 
score for that protocol* This procedure was followed for both the pilot and 
the main study* 

Test-retest reliabilities of *59 for the fluency score and .63 for 
originality were obtained fxcm the pilot test results (N « 35) * The practice 
effect was significant for the fluency scores t(24) = 4*61^ £ < *001* ror 
the originality score the practice effect was not significant, U34) = '•*52* 

For use in the multitrait-multimethDd matrices, this task was classified 
as a group-administered verbal measure of Level II intelligence* 



Mathanatics Portion of the SRA Skills Profile 

The computation and concepts sfjbtest raw scores from the mathematics 
portion of the Science Research Associates (SRA) Skills Profile, battery 2-4, 
were collected from existing school records with consent of parents* The most 
recent data available were from the last districtwide test administration 
during the 1973-74 school year* 

The concepts subtest requires children to translate verbal forms into 
mathematical symbols* Children must also demonstrate their knowledge of the 
vocabulairy of arithmetic as well as their understanding of mathematical prin<* 
ciples* The confutation subtest requires children to apply the mechanics of 
computation to problems involving whole numbers, fractions, and decimals 
(Thorpe, Lefever, & Naslund^ 1964)* 

Coefficients of internal consistency were reported by the test authors* 
Using the KR? n formula for each of two parallel forms of the concepts subtest 
on a sample of 200 fourth grade children for each form, coefficients of *80 
and *83 were obtained* 1^20 coefficients for two parallel forms of the com- 
putation subtest were *67 and *89 for the same sanq^le* Test-retest reliabili- 
ties are not available for these subtests (l!horpe, Lefever, £ Naslund, 1964)* 



Gates-MacGinitie Reading Test 

The vocabulary and oc^nprehension subtest raw scores from the Gates- 
MacGinitie Reading Test, Survey D, Form 2, were collected from existing school 
records with consent of parents* The most recent data available were from the 
last districtwide test administration during the 1973-74 school year* 

The subtests may be described as follows: The vocabulairy subtest samples 
the child's reading vocabulary* The test contains SO items* Bach te^t word 
is followed by five alternativeif; the child must choose the word which means 
most clearly the same as the test word (Gates St MacGinitie, 1965a)* Test- 
retest reliability was reported by the test authors* For the vocabulary subterst 
the test-retest reliai-ility is *85 (Gates 6 MacGinitie, 1965b)* This reliabi- 
lity was calculated using parallel forms administered less than a week apart to 
a sample of approximately 780 fourth grade children* 
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Itie comprehension subtest measures the child's ability to read prose 
passages with understanding* There are 21 passages in vhlch a total of 52 
blank spaces have been introduced; five alternatives are offered as oomple-^ 
tions for each blank space* The child must decide ^ich one of the five 
completions best conforms to the meaning of the whole passage (Gates £ 
HacGinitie^ 19e5a) * The test authors report a test*retest reliability of 
*S3 for the conprehension subtest* This reliability was c^tained using parallel 
forms of the instmnent administered less than a week apart to a sample of 
approximately 780 fourth grade children (Gates HacGinitle^ 196%)* 

SUHHARY OF PILOT STUDY RESULTS 

Itie results of pilot studies conducted to establish reliabilities for 
several of the tests used in this research have been discussed in connection 
with the respective tests* By way of sunary^ Table 2 reports the basic 
statistics and reliabilities obtained in each pilot conducted^ As may be 
seen from the standard deviations ^ adequate range was obtained on all of the 
tasks* Hbne of the tasks appears to have been very easy* The BA task was 
especially difficulty but poor performance is to be ea^ected on the first 
trial of such a task* Reliabilities reported are not as high as desired^ but 
the strcmg learning effects in several of the pilots may account in part for 
this result* Guilford (1967^ p* 16) states that Variables that are factor 
analyzed need not have high reliabilities* Experience shows that a fairly 
satisfactory factor^analytic solution can be obtained ^en some variables have 
as low a reliability a^ *4*" The Level X tasks especially seem less reliable 
than vas expected^ but it is argui'td that with the exception of the visual 
memory test^ \^ch was not used in the analysis of the results of the main 
study^ all are operationaiizations actually anployed in the study of Level Z 
and Level xx intelligence* 



PROCEDURE 

Two weeks before the main study commenced^ a meeting was held with the 
district's fifth grade teachers* During this meeting the following topics 
were discussed: purpose of the research^ brief review of the tests to be 
usedf confidentiality of results^ and logistics of the testing procedures* 

After the meeting with teachers ^ permission slips and an accon^nying 
explanatory letter describing the research and testing situation were mailed 
to the parents of all fifth graders in tlie school* A request for family 
background information and letters of permission to be returned to the school 
were included* A copy of the letter and parental approval form can be found 
in Appendix B* tJtpon receipt of the parental approval forms each fifth grade 
class in the ccmplying school district was visited and all white children in 
the fifth giade whose parents consented were included in the study* Each 
child was tested Individually for 50-60 minutes by 1 of 12 trained test ad'* 
ministratcrs* Seven tests were administered during the individual adminis* 
tration* The order in which the tests were presented was the same for all 
children* The order of tests and apprc»cimate times used in administration 
were as follows: 

1* Similarities from the WISC^K (5 minutes)* 

2* PA Xask (3 minutes)* 

3* Ujicategori2:ed Free Recall (11 minutes) * 
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TABLE 2 

SUMHWY STATISTICS FOR EACH PItX>T STUDY 



T^st and Variable 


Administra- 
tion 1 


Administra- 
tion 2 

X SD 


Test-Retest 
Reliability 


H 


t for 
Practice 
Effect 


Categorized Free 


2.92 


.91 


3.43 


1.26 


.74 


23 


3.20* 


Recall Z Index 
















DSU Bhyining Fluency 


5.69 


1.64 


6.80 


1.49 


.59 


35 


4.61* 


DSU Bhyining Originality 


1.32 


.32 


i.no 


.19 


.63 


35 


-.52 


WISC-R Coding 
















Ind ividua l-Group 


32.29 


9.14 


41.64 


8.23 


.81 


14 


6.43* 


Group-Individual 


36.00 


7.96 


42.59 


9.32 


.74 


17 


4.31* 


Paired Associate Task 


2.81 


1.63 


4.14 


2.39 


.55 


21 


3.01* 


Uncategorized Free 


51.32 


6.11 


60.57 


6.20 


.41 


26 


7.33* 


Recall 
















Visual Memory 


3.20 


.71 


3.17 


.70 


.48 


30 


-.25 


for Sytnbols 

















The Coding B pilot was not conducted to assess test-retest reliability, but 
to establish the equivalence of group and individual (standard) forms of 
administration* One group received first the group, then the individuaJ 
forms of the administration, and a second grot^ received the individual 
administration first* The pooled within'-group correlation was *77, H = 31* 
The correlations for eadi group are given in the coluoin labeled Test-Retest 
Reliability* 

Ihe pilot results are presented for the final form of this instrument, scored 
as described in the text* Although this test was administered in the main 
study, results had to be dropped from the analyses due to poor testing condi- 
tions* 

*£ < .01* 
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4* Digit Span from the WISC-R (3 minutes)* 

5. Block Design from the WISC-R (10 minutes). 

6. PPVT (15 minutes). 

7. Categorit^ed Free Recall (11 minutes). 

liie order of the tests was logically determined to minimize interference 
among the various subtests. For example, a response set or strategy estab* 
lished during a free recall task could be detrimental to performance on 
subsequent PA task. An attempt was also made to maximize the time between 
the two free recall administrations to reduce interference between the tasks. 

All children were also tested in c/assrooai*sized groups ,for approximately 
40*45 minutes by a trained test administrator. Four tests were a^ninistered 
during the group administration. The order In which the tests were presented 
was determined logically to miniiaize interference among the tests, and the sme 
order was used for all gro^ administrations. Die order in which the tests 
were administered and the time estimates for each instninent were as follows: 

1. Visual M^ory Test (5 minutes). 

2. Guilford DSU Hhyming (2 minutes). 

3* Coding B from the WISC*^R (approximate time needed). 
4. Raven^s CPH (30*^35 minutes). 

Hhenever possible, group administrations occurred after all children in 
a fifth grade class had received the individual administration. Results of the 
visual memory test were not used in the main study, due to problents in adminis- 
tering the task. 

All 12 test administrators were graduate students fr^ the departments of 
Educational Psychology, Child Developnent, and Guidance and Counseling of the 
university of Wisconsin at Madison, ^e test aAninlstrators were trained for 
10 hours regarding the establishment of rapport with examinees, individual 
test administration procedures, and scoring and statistical properties of 
tests. Two individual sessions were conducted with each administrator to ensure 
masteiry of the individual administration procedure, and they viewed a d^nonstra* 
tion administration of the Individual battery to a fifth grade child. 

Instructions used for each of the standardized tests or subtests except 
the WISC-R Coding B subtest were those presented in the aaninlstrator's manuals. 
All test a<^inistrator5 were ^ite, and each tested an approximately equal 
number of males and females. Test administrators had no information regarding 
the anticipated outcomes of the study. 

Achievement scores for each participating child were obtained from existing 
school records whenever available. A photocopy of the signed parental approval 
form giving permission to test the child and enter bis/her school records was 
left in each child's school. Family background information was not photocopied. 
Achievement data was not collected until all testing in a givep school was 
completed. 

Children *s names were not recorded on any test or form listing achievement 
scores. A unique code number was used to identify all the information for any 
one child, but no association of any child*s name with his code number was 
maintained after data collection in the school was completed* Schools w^^ 
not provided with individual results, but findings of the research study will 
he made available upon request. 



37 



28 



STATISTICAL ANALYSES 

rrhe variables employed in all analyses are specified in l^ble 3* The 
two classifications of the.vsiriables by methods according to adtatinistration 
type and response mode determine their placement in each of the multitrait** 
nmltimethod matrices* For purposes of the first type of matrix, each task 
in the battery is classified as an operationali^tion of either Level I or 
Level II intelligence (trait) enploying either a verbal or a nonverbal response 
mode (method)* In the second type of matrix the classification by trait 
remains the same# but each test is classified by type of administration^ either 
individual or group* 



Statistical Analyses Used in Testing the Hypotheses 

To test the first hypothesis^ i*e*# that a factor analysis of all 15 
variables would yield three main factors corresponding to two types of Level 
II intelligence labeled ^ and £c ^ Jensen (1973) and a memory factor 
corresponding to Level I intelligence, a principal components analysis was 
performed* A proiitax rotation of the factors with eigenvalues greater than 
1*00 was examined following the methodology prescribed by Jensen (1973)* It 
was predicted that in the rotated factor matrix^ factors corresponding to memory^ 
c[f and 2^ would be identified such that each variable would load *30 or greater 
on its corresponding factor as identified in Table 3, and less than *30 on 
other factors* These predictions were made on the basis of Jensen's (1973) 
findings of a three-'factor space of intelligence^ which he interpreted with 
reference to Cattell's constructs of fluid and crystallized intelligence* 

A second principal components factor analysis was performed using only 
9 of the IS variables* WISC-R Coding B, PA task, uncategorized free recall, 
WISC'R Digit S!pan forwards CH1# WISC-R Similarities, WISC-R Block Design^ 
categorized free recall, and PPVT* The variables not included were: DSU 
rhyming (neither fluency nor originality scores) and the foftr scholastic achieve- 
ment test scores obtained fron school records (SRA Math Concepts^ SRA Math 
Cotnprehension) . The reason for perf:>nQing this second factor analysis was to 
detertoine if U£>ing a smaller but "purer** set of measures of Level I and Level ij 
intelligence would result in factors corresponding to the constructs of Level I 
and Level II intelligence* It was not until Jensen's 1973 article and the 
finding of a three-factor space £c ^ memory factor) that Level II was 
discussed with reference to Cattell's constructs of intelligence* 

Ihe DSU rhyming task was dropped from this apAly^^is because it is intended 
as a measure of creativity; although it requires the ability to transform 
semantic units, which is a Level II operation, it also involves divergent pro- 
duction (Guilford, 1967) # which would not be synonymous with Level II intelli- 
gence* Guilford <1950i p* 446) has stated that ^we must look well beyond the 
boundaries of the IQ if we are to fathom the domain of creativity**' 

The four scholastic achievement tests were dropped from this analysis 
because they were designed to measure scholastic achievement in specific skill 
areas* The items included in both the SRA math tests and the Gates-^HacGinitio 
reading tests require the application of school- learned rules and/or procedures* 
Hence, they arc? not considered particularly pure measures of Level II intelli- 
gence* 

To test Hypotheses II and III, the Pearson productHonoment correlations and 
internal consi;itency or test-retest reliabilities were inserted into four multi^ 
trait-multimetliod matrices designed an follows* For the first two matrices^ all 
15 variables wore sorted by trait (Level I intelligence versus Level II intelli- 
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TABLE 3 

MULTIPLE CUlSSIPIC^TiaiS OP ALL TESTS 
BY TRAIT AKD HETH<K> 



Hethod 

T^st Besponse Hode Administration Type 



Qperationali sat ions of Level X Tntelligence 



WISC-R Coding E 


ttonverbal 


Group 


Paired*>AS5ociate Task 


Verbal 


Individual 


Uticategorized Free Recall 


Verbal 


Individual 


WlSC-R Digit Span 


Verbal 


Individual 


Ope rationalizations 


of XiBvel II Intelligence 




Haven's CPH 


Nonverbal 


Group 


WISC-R Similarities 


Verbal 


Individual 


WISC"R Block Design 


Nonverbal 


Individual 


Categorized Free Recall Index 


Verbal 


Individual 


Operationalizations of Level II Intelligence i^) 


DSU Bhyming Fluency 


Verbal 


Group 


DSU Rhyming Originality 


Verbal 


Group 


PPVT Raw Score 


Verbal 


Individual 


SRA Math Concepts 


Verbal 


Group 


SRA Math Computation 


Veibal 


Group 


Gates'-MacGinitie Vocabulary 


Verbal 


Group 


Gates-MacGinitie Comprehension 


Verbal 


Group 
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gence) within method, as indicated in Table 3. For the first aatrivr the niethod 
used to group the variables was response mode (verbal versus noBverbal)* For 
the second matrix^ the method used to gzot^ the variables was administration 
type (group versus individual). The third and fourth matrices were formed using 
exactly the same trait and method categories, but included only the 9 variables 
which were used in the second factor analysis, described above as **pwrer** 
measures of Level I and Level II. 

Hypothesis II, regarding the convergent validity of the constructs, was 
tested by examining the magnitudes of the correlations within the multitrait- 
multimethod matrices. It was predicted that e^^^h correlation between two 
operational izat ions of the same trait (Level I intelligence or Level II intelli** 
gence) would be significantly greater than zero, ntiis hypothesis was tested 
by the use of Fisher *s ^to Z transformation. 

Hypothesis III, concerning the discriminant validity of the constnicts, 
stated that the correlation between any two operational izations of the same 
construct will be higher than either of their correlations with any operationali- 
zation of the other construct. Since only relative magnitudes of intercorrela* 
tions ar^ examined, no tests of significance were performed. Campbell and 
Fiske (1959) examined only the relative magnitudes of correlations in their 
discussion of discriminant validity as evidenced in the multitrait-multimethod 
matrix. They do not recommend the use of statistical tests for examining 
discriminant validity, but do suggest significance tests when examining con^ 
vergent validity. 



Supplementary statistical Analysis 

One additional statistical investigation was performed: the Pearson 
product-moment correlations of scholaistic achievement as measured by the SHA 
Mathematics Achievement Test and the Gates-MacGinitie Heading Test with each 
of the other variables were coinputed. Tests of significance using Fisher*s 
r^ to 2 treuisformation were performed to determine whether each correlation 
I'^s different from zero. 



LIMITATIONS OF THE RESEARCH 

To facilitate appropriate interpretation of the results which are pre- 
^^sented in Chapter IV, certain methodological and procedural weaknesses of the 
study will be briefly indicated. 

While test administrators were carefully trained, the conditions under 
which individual administrations were conducted varied widely from school to 
school* In several schools, it was impossible to secure facilities for 
quiet and/or uninterrupted individual testing. The coJ lection of data under 
adverse conditions may have reduced the magnitude of the intercorrelations 
among the various measures. 

The process of choosing tests to serve as adequate opera tionaliza tions 
of lievel I and Level II intelligence requires adequate definitions of the con- 
structs* Jensen*s definitions specify internal processes, with little discus- 
sion of observable behavior. Therefore it is difficult to assure the adequacy 
of the operationalizations employed* In particular, there is some evidence 
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that some operationalizations of Level I elicited Level II processes in at 
least some of the children tested* 

The correlations of the PA task and df'*tGe'"CFH with the other measures ' 
may have been attenuated due to the levels of difficulty of these two tasks* 
Performance on the PA task was generally poor, and not much variation was ob- 
tained* On the CPM, some ceiling effect was evident* 
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IV 



RESULTS 



Followiiig a brief presentation of descriptive statistics on each variable 
and the correlation of sex with each variable^ the results of the stud/ will 
be presented with regard to the three hypotheses tested; a suppl^Miitary analy 
sis relating scholastic achievement to each of the other variables will also 
be given* The section on the first hypothesis will include the results of 
the principal ccnponents analysis followed by a prtxnax rotation using all 15 
variables, as well as the results of the same statistit-al procedure using a 
siibset of 9 variables which are **purer** measures of the constructs* sec- 
tion on the second hypothesis will include presentation of the four muXi-j-trait 
multimethod matrices and the results of the significance tests concerning the 
convergent validity of the constructs* The secti<m concerning hypothesis III 
presents tabulations of the relative magnitudes of various pairs of correla- 
tionsr as described in the statistical procedures section of Chapter III* The 
fourth section will present the results of the supplementary statistical in- 
vestigation regarding the correlation of scholastic achievement with each of 
the other variables* 



DESCRIPTIVE STATISTICS 

The meant standard deviation^ miniroumr and maximtin for each of the 15 
variables used in the study are presented in Table 4* In general the tests 
appeared to be of appropriate difficulty^ although the mean of the PA test is 
quite low* This was to be expected with only one study trial being presented* 
The range of scores on the PA test indicates that there were children capable 
of attaining the maximum score* Examination of the CPM results indicates the 
possibility of a ceiling effect, but the test is reported to be appropriate 
for use with children through age 11 (Baven, 1965)* The mean age of this 
sanq^le was 10 years 7 months^ no- children were included in the data analysis 
^o had reached age 12* 

- The point-biserial correlation of sex with each of the variables is given 
in Table 5* Of the 15 point-biserial correlations reported/ 6 were signifi- 
cantly different from zero at an alpha level of £ < *05, and 4 of those were 
significant at an alpha level of £ < *01* These correlations were computed 
on the entire sample of 221 children* 

For the two free recall tests, the stimulus materials employed included 
doll house furniture and doll clothes^ these may have been of more intrinsic 
interest to girls than to boys, contributing to the significant correlation of 
sex with these two tests* No ejcplanation is offered for the remaining signi- 
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TABLE 4 

MEAN, STAHCARD DEVIATION^ HINIHUMr AHD 
MAXIMUM FOR EACH VARIABLE 





Mj4v^ fniim 










Variable 


Possible .Score 


X 


SD 


Minimvan 


Haxijnum 




100 


Al 90 


7.56 


22 


62 


Paired-Associate Task 


8 


1.54 


1.37 


0 


8 


Un categorized Free 


80 


49.92 


6.17 


29 


68 


Recall 












WISC-R Digit Span^ 


14 


6.21 


1.81 


2 


13 


Raven *s CPM 


36 


30.66 


3.60 


18 


36 


WISC*R Similarities 


30 


15.00 


3.43 


7 


24 


^Tcr**i> Til rvV D^^inn^ 


62 


29.09 


10.66 


2 


54 


Categorized Free 


6.75 


2.51 


.96 


-.63 


4.83 


fvecaii ^ inaex 












DSU Ilhyining Pluency 


none 


rr OA 

5. 84 


1. 50 


1 


10 


DSU Jthyming Originality 


3 


1.32 


.21 


1.00 


2.00 


PPVT Raw Score^ 


150 


88.76 


7.90 


69 


112 


SRA Math Concepts 


47 


26.11 


5.54 


7 


37 


SRA Math Computation 


47 


18.30 


4.78 


3 


24 


Gates'-MacGinitie 


50 


28.02 


7.32 


6 


41 


Vocabulary 












Gates-MacGinitie 


52 


31.35 


10.07 


5 


50 


Comprehension 













^^ese variables comprised the nine "purer" measures used in the second factor 
analysis and the third and fourth multitrait-mAiltimethod matrices* 
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TABLE 5 



POINT- BISERIAL CORREtATIOK OF SEX WITH EACH OF THE 
FIFTEEN VAKIAfilES INCLUDED IN THE STUDY 



Variable 


^u£Xc xa t-xiJji 


WISC*R Coding B 


.293** 


Paired-Associate Task 


-.104 


Uncategorized Free Recall 


.193** 


WISC-R Digit Span Forward 


-.054 


Raven's CPM 


-.020 


WISC-R Similarities 


-.140* 


WISC*R Block Design 


-.156* 


Categorized Free Recall-Z^ 


.239** 


DSU Rhyming Task-Fluency 


.074 


DSU Rhyming Task-Originality 


.034 


PPVT Raw Score 


-.222** 


S?A Math Concepts 


-.049 


SRA Math Computation 


.114 


Gages-MacGinitie Vocabulary 


-.060 


Gates-MacGinitie Cdmprehension 


.016 



*£ < .05 
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ficant correlations* Since it was not the intention of this stu<fy to examine 
sex differences, separate analyses of the data for boys and for girls were not 
performed* 

HYPOTHESIS I 

Hypothesis I states that the factor analysis of a large test battery 
consisting of multiple operatiqnalizations of each of Level I and Level II 
intelligence will yield three main factors corresponding to the two types of 
Level II intelligence delineated by Jensen (1973) with reference to Cattell's 
(1963) theo3:y# and a memory factor representing Level I intelligence* 

In order to test this hypothesis all 15 test scores for each child were 
intercorrelated, chronological age was partialed oiit of all interoorrelations 
following the methodology used by Jensen (1973), and the resulting matrix was 
subjected to a principal ccnponents analysis* FACTORS, a computer program 
maintained by the University of Wisconsin Acadentic Canputing Center, was used 
to derive the principal components (Academic Conq^uting Center, 1974)* Factors 
corresponding to eigenvalues greater than 1*00 were then rotated to oblique 
simple structure using the promax procedure described by Hendrickson and 
-White (1964)* Six factors emerged with eigenvalues greater than 1*00* The 
eigenvalues corresponding to the six unrotated factors, which accounted for 
65*4 percent of the total variance* are 3*7723, 1*5563, 1*2142, 1*1593, 
1*0630, and 1*0385* Table 6 presents the oblique factor loadings* The inter- 
correlations among the factors* presented in Table 7, were all less than *31 
in absolute value, suggesting that the six factors are relatively independent 
of one another* 

Significant factor loadings are summarized in Table 8* The only variables 
^diich load significantly on the first factor are the SRA jnath concepts and 
computation subtest scores, suggesting that the first factor might be a school- 
related mathematical ability factor* Four of the 15 variables load signifi- 
cantly on the second factor; WISC-R similarities, PPVT raw score, and both 
the vocabulairy and comprehension subtest scores of the Gates<^MacGinitie 
Heading Test* These four measures support the interpretation of the second 
factor as a language ability factor heavily saturated with size of vocabulary- 
The third factor is not as school related as the first two factors discussed* 
The variables loading significantly on the third factor are Raven *s CPH and 
the WXSC-R Block Design sxibtest, both tests of skills which are not taught 
as part of the typical school curriculum* Neither of these tests require 
overt verbalizations although both may depend upon covert verbalizations- 
The cognitive operations required for successful performance on both of these 
tests have been described by various psychologists as requiring con^^lex 
reasoning strategies (Wechsler, 1949; Glasser & Zimmerman, 1967; Raven^ 1965)* 
Since both of the tests have been characterized as requiring cc^lex reasoning 
strategies which may in turn require implicit verbal manipulations in order 
to either reproduce or con^lete a matrix of visual stimuli, it is insufficient 
to refer to the third factor as a perceptual or spatial ability factor* Rather, 
the factor might be labeled as abstract reasoning using figural content* 

The PA test and the digit span test are the 2 variables which load signi" 
ficantly on the fourth factor; clearly it can be labeled a short-term rote 
memory factor* This interpretation can be supported since there was only one 
study trial for the PA test and the use of verbal labels or production of 
sentences or stories to facilitate memorization of the two pictures ccHnprising 
a pair was not encouraged. Therefore, successful performance on both digit 
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TABLE 6 

FACTOR STRUCTURE OF THE ROTATED PRINCIPAL 
OOMPONENTS OF TSE FIFTEEN VARIABLES 





Component 


Variable 


I 


II 


III 


IV 


V 


VI 


WISC'-R Coaing B 


.020 


-.272 


.089 


.308 


-.015 


.466* 


Paired- Associate Task 


-.204 


-.404 


.105 


.729* 


-.127 


-.021 


Uncategorxzea Free 


.276 


-.089 


.211 


-.106 


-.140 


.287 


WXbL.^K uxgx^ span 


.011 


. ijHX 


— . xuo 






288 


ivaVen S UtrTl 


. 167 


.059 


. 599* 






''.052 


UT C^teD C 4 'm4 1 Av4 4*1 Ac 


-.114 


.669* 


.291 


.072 


-.199 


.013 


WISC-R Block Design 


.069 


.095 


.804* 


.005 


.132 


.090 


Categorized Free 
Recall Z Index 




145 


^ 140 


-.201 


Oil 


852* 


DSU Rhyming Fluency 


.029 


.019 


.125 


.090 


.619* 


.103 


DSU Rhyming Originality 


-.083 


-.081 


.102 


-.137 


.854* 


-.043 


PPVT Raw Score 


-.051 


.805*. 


.058 


-.118 


-.006 


.012 


SRA Math Concepts 


.727* 


.127 


.008 


-.183 


.001 


-.102 


SRA Math Computation 


.774* 


-.159 


.020 


-.052 


-.092 


-.138 


Gates-MacGinitie 
Vocabulary 


.253 


.456* 


-.160 


.251 


.058 


.059 


Gates-MacGinitie 
Comprehension 


.281 


.410* 


-.124 


.129 


.091 


.155 



Factor loadings significant at the .01 level {Harmon, 1967). 
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TABLE 8 

SK^IFICAHT LOADIHGS OH THE BDT7VTCD FACTORS FROM 
THE ANALYSIS OF AH. FIFTEEN VARIMaLBS 





Factor 


Variable 


Mathematical 


Language 

Ah ill ^ V 


Abstract 
Reasoning Using 


Short Term 


Creativity 


Mnemonic 

Facilitv 


WISC-R Coding B 












* 


Paired-Associate Task 








* 






tjncategorized Free 
Recall 














WISC-R Digit Spin 








* 






Raven *s CPM 






* 








WISC-R Sijnilarities 














HISC*R Block Design 






* 








Categorized Free 
Recall Z Index 












* 


DSU Rhyming Fluency 










* 




DSU Rhyming Originality 










* 




PPVT Raw Score 




* 










SRA Hath Concepts 


* 












SRA Hath Conqputation 


* 












Gates-HacGinitie 
Vocabulajcy 




* 










Gates-MacGi nitie 
Comprehension 




* 
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span and the PA test required ijomediate recall of a set of stimuli whicn were 
purposely selected to discourage any verbal mediation. This factor is very 
close to Jensen*s X^vel ^ factor. The two varietbles ^ich load significantly 
on the fifth factor are the DSU fluency and originality scores. Since both of 
these scores loaded together on this factor, it seems appropriate to label 1;^ 
a creativity 1 4Ctor. 

The WISC*H Coding B subtest and the categorized free recall Z index load 
significantly on the sixth factor. Although sotne of the characteristics of 
these two tests seem quite different, they are alike in that they provide an 
opportunity for mnemonic strategies to develop. In the coding test, the child 
is presented with a key of numbers and arbitrary symbols such that each nuniaer 
is associated , with a unique symbol. As described in Chapter III, the child is 
given two minutes to fill in a grid where a row of numbers is presented^ s/he 
must fill in the box below each number with the ajrpropriate synibci - The key 
with numbers and symtols is present before the child the entire !e during 
which s/ne is performing, thereby providing an opportunity to develop a facili- 
tative mnemonic strategy. An exanple of such a strategy might be giving one 
of the symbols a label, fo^: example, calling the symbol **^** a **sideways T.** 
Such labels may help the child recall the way the syuhol looks and facilitate 
production of the grapheme. In the categorized free recall test, the child is 
presented with the same 20 objects in succession on each of fo\ir trials. On 
each trial the 20 objects are presented in a different random Order. The child 
has ample opportunity to become aware of the a priori categories implicit in 
the stimulus objects (five emimals, five pieces of clothing, five pieces of 
furniture, five pieces of tableware). 

Boua^field and his associates demonstrated that subjects will recall 
randomly presented materials in clusters (bousfield, 1953). It was also demon* 
straVed that as the number of presentations of the stimulus increases, the 
clustering tendency increases (Bousfield & Cohen, 1953). More importantly, 
there is a strong correlation between the degree of clustering and the amount 
of recall (Bousfield Cohw/ 1955). 'The fact thrt there are four trials during 
which these categories may come to be recognized encourages the development of 
mnemonic strategies. The variable being analyzed for the categorized free re* 
call test is the mean val^ of the clustering index, Z, across the four trials. 
Diis index is a measure of the amount of clustering evident in the set of 
objects recalled. It reflects the degree to which the particular mnemonic 
strategy of clustering the objects with respect to the experimenter-^provided 
categories was enqployed. In other words, on both the coding and categorized 
free recall tests the child i? repeatedly exposed to the stimuli, allowing for 
the development of useful mn^*.,onic strategies. In further support of this 
interpretation, the variable with the next highest loading on this factor was 
the free recall uncategori^^d test. Given that there are repeated presenta* 
tions of the stimuli in this test also, performance could again b^ facilitated 
through the use of a mnemonic strategy. In view of this interpretation, the 
sixth factor is referred to i:^ a mnemoii^c facility factor. 

Ilie obtained six-^factor solution bears little resemblance to the three* 
factor solution predicted in Hypothesis I. Ilie four variables which wer^ 
chosen as operational iza tions of ^ or Lc*^el II fluid intelligence should have 
loaded on a single factors instead they loaded significantly on three of the six 
factors. 1^ summarize, the placement of the four v^u:iables predicted to load 
on the 2, factor is as follows; the WISC-R similarities subtest loaded heavily on 
the language ability factor. Raven's CPM an:y the WISC-H block design subtest 
loaded on the abstract reasoning using figural conten'^ factor, and the categorized 
free recall test loaded on the mnemonic facility factor. The six variables 
predicted to load on the ^ factor instead loaded on three factors: the SKA 
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Hath Concepts and Computation subtests loadea on the mathematical ability factor, 
the PPVT and the Gates-MacGinitie Vocabulary and Con^rehension subtests loaded 
on the language ability factor, and the DSU rhyming fluency and originality 
scores loaded on the creativity factor* Of the four varied^les chosen as opera- 
tional izations of Level I intelligence and predicted to load on a memory factor, * 
two, the PA test and the WISC-R digit span subtest, did load on a short term 
rote memoiry factor closely corresponding to Jensen's Level I, but the WISC-H 
Coding B subtest loaded on the mnemonic facility factor and the uncategorized 
free recall test failed to load significantly on any of the six factors* 

These results give little support to the first hypothesis* In a further 
attempt to find evidence to uphold the existence of the constructs, 9 of the 
original IS varied^les were selected to be used in a second factor analysis* The 
rationale for this analysis was that the factor predicted in Hypothesis I 
represented a significant departure from Jensen's original theoiry of intelligence 
(Jensen, 1969)* In the original theory. Level II intelligence was not split into 
crystallized (a) and fluid (3^), but rather was considered a unitary analytic 
ability* Six of the seven operationalizations of were dropped for this second 
analysis* itie PPVT raw score was kept because Jensen (1970a) and Rohwer (1970) 
used it in earlier research as a measure of Level II intelligence* For the purposes 
of this study the PPVT had been classified as an opera tionalizat ion of ^ due to 
its reliance upon culturally transmitted information* Jensen (1970a) also recognized 
this quality of the test, but found evidence that the test taps Level II processes 
in that it correlates *72 (N = 638) with RavenU CP«* With the removal of the 6 
other variables classified as measures of it was anticipated that two factors 
corresponding to Jensen's earlier theoiry would emerge* 

The WISC-R Coding B subtest, PA test, uncategorized free recall and the 
WISC-R digit span subtest were expected to load on one factor corresponding to 
Level I intelligence, and Raven's CPM, the WISC-R similarities subtest, the WISC*R 
block design subtest, the categorized free recall ^ index £knd the PPVT raw score 
ware expected to load on a second factor corresponding to Level II intelligence* 

The matrix of intercorrelations among the 9 variables to be included in 
the second factor analysis, after partialing out chronological age as before^ was 
subjected to a principal conqponents analysis* Factors correspond.ing to eigenvalues 
greater than one were then rotated to oblique simple structure using the promax 
procedure. Three factors emerged with eigenvalues greater than 1*00; these 
eigenvalues are 2*0117, 1*3787, and 1*1154* The three factors accounted for 
50*1 percent of the total variance. Table 9 presents the oblique factor loadings* 
The intercorrelations among the throe oblique factors are presented in Table 10* 
The intercorrelations among the three oblique factors are all less than *15 in 
absolute value, suggesting that the three factors are relatively independent of 
one another* 

Significant factor loadings frcmi the second factor analysis are summarized 
in Table 11* Five variables loaded signific^tly on the first factor: the WISC-R 
Coding B subtest, uncategorized free recalJt^ Raven's CPM, the WISC-R block design 
siubtest and the categorized free recall index* This factor clearly does not 
correspond to either Level I or Level II intelligence as anticipated* Rather, 
2 variable£^ considered to be operationalizations of Level I and 3 variables 
considered to be operationalizations of Level II loaded on the factor* These 
5 variables include all of those which loaded significantly on either the abstract 
reasoning using figural content factor or the mnemonic facility factor in the 
15-variable solution, and 1 additional variable, the uncategorized free recall 
test, which previously had not loaded significantly on any factor* As pointed 
out in the presentation of the first factor analysis, the significant loadings 
of the wiSC-R Coding B subtest, the categorized free recall 2 index. Raven's 
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TABLE 9 



FACTOR STRUCTURE OF THE ROTATED PRINCIPAL 
COMPOHEHTS OF THE KIHE VARIABLES 





Compoiiisnt 




I 


II 


III 


Wise-R Coding B 


.655* 


-.312 


-.214 


Paired^Associate Task 


.156 


-.103 


,662* 


Uncategorized Free 
Recall 


i ■ ^ 

.650* 


-.008 


-.102 


WISC-R Digit Span 


-.060 


.100 


.740* 


Raven* s CPM 


.588* 


.244 


,112 


WISC-R Similarities 


.101 


.729* 


,096 


WISC-R Block Design 


.528* 


.233 


-,009 


Categorized Free 
Recall Z Index 


.486* 


-.084 


-.329 


PPVT Raw Score 


-.087 


.823* 


-.044 



*Factor loadings significant at the .01 level (Harmon* 1967). 



TABLE 10 



XNTBRCORRELATIOMS AMONG THB THSEB QBUQUE FACTORS 



Factor 


I 


II 


III 


I 


1-000 






II 


-,149 


1.000 




III 


-.054 


-,097 


1.000 
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TABLE 11 



SIGNIFICANT LOADINGS ON THE ROTATED FACTORS FROM THE 
ANALYSIS OF THE NINE VARIABLES 





Factor 




Strategy 
Usage 


Verbal 
Intelligence 


Short-Term 
Rote Memory 


WISC-R Coding B 


it 






Pair€d*Associate Task 






it 


Uncategorlzed Free 
ItecaxI 


it 






WISC-R Digit Span 






it 


Raven's CPM 


it 






WISC*-K Similarities 




it 




WISC-R Block Design 


it 






Categorized Free 
Recall Index 


it 






E>PVT Raw Score 




it 





ERIC 
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CPH and the WISC-R block design subtest on this factor suggest some inter- 
section of mnemonic facility and abstract reasoning* The attribute comnon 
to both these factors which e m e rged in the preceding factor analysis is the 
necessity of discovering strategies for successful perfonnance* These strategies 
may be rules or procedures which result in jbhe successful conpletion of one of 
the matrices or the reproduction of one of the block designs, or they may be 
organizational structures used to facilitate the recall of arbitrary symbols or 
objects* In the light of these considerations^ the factor might best be named 
strategy usage* 

The significant loading of the uncategorized free recall test on this 
factor remains to be considered* There is extensive literatmre to suggest 
that on tasks where stimuli are not categorized a priori by the experimenter, 
subjects imf>ose their own subjective organization (Tulving, 1962; Seibel, 1964; 
Bousfield, Puff, & Cowan, 1964), Tulving's index of subjective organization 
( so) is an index developed for measuring the subject's tendency to **recall items 
in the same order on different trials in the absence of any experimentally 
manipulated sequential organization among items in the stimtlus list (Tulving, 
1962, p* 3521*** Although the use of this index would have been an ideal method 
for determining the amount of strategizing or organizing children did on this 
taskr results of the pilot test indicated that the index is unreliable when 
only four trials are administered* Therefore, it was not used as a variable 
in this study* However, it is well documented in the literature that **subjects 
do impose a sequential structure on their recall^ that this subjective organiza- 
tion increases with repeated exposures and recall of the material, and that 
there is a positive correlation between organization and performance (Tulving, 
1962^ p* 3521*** Such organization represents a type of strategy* In the light 
of this information the uncategorized free recall test does lend support to the 
interpretation of the first factor as representing strategy usage* The variables 
which loaded significantly on the second factor were the WISC-R similarities 
subtest and the FPVT raw score* This factor is very similar to the language 
ability factor found in the previous factor analysis except that the two reading 
achievement tests are not included* It is possible that this factor reflects 
verbal intelligence^ since both the WISC-R similarities subtest and the PFVT 
were constructed to assess verbal intelligence; it will therefore be referred 
to as a verbal intelligence factor* The third factor in this solution corresponds 
perfectly to the short-term rote matory factor found in the first factor analysis* 
WISC-R digit span and the PA test load significantly on the factor* Hence, it 
will once again be referred to as the short-term rote memory factor^ a close 
approximation to Jensen's Level I factor* 

In summary, the second factor analysis is somewhat similar to the first 
six-factor solution* The strategy usage factor appears to be a combination of 
the mnemonic facility and abstract reasoning using figural content factors found 
in the first factor analysis* Both factor analyses have factors representing 
language or verbal abilities as well as a short-term rote memory factor* The 
results of the second factor analysis still do not provide support for the 
constructs of Level I and Level II intelligence* The first factor named^ 
strategy usage, has tests purporting to measure both Level I intelligence and 
Level II intelligence loading on it* one implication of this finding may be 
that there are very few valid tests of Level I ability; one may reason that 
children will use strategies and organize stimuli input on almost any test, 
such that the test is no longer measuring Level I intelligence (rote memory) 
but rather the child's ability to strategize or organize* The verbal intelligence 
factor was not expected in that both the WISC-R similarities subtest and the 
PPVT were expected to load on the same factor as Raven's CPH, WISC-R block 
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design, etc* if a unitairy Level ii factor existed* The short'-tenn rote memory 
factor is in accordance with Level I intelligence, but as mentioned earlier 2 
of the 4 variables expected to load on the factor loaded on the Strategy Osage 
factor instead* Inasmuch as the results of the two^ factor analyses failed to 
substantiate the existence of the constructs of Level I and Level ii intelligence 
in either their original formulation or their reformulation using Cattell's 
constructs o£ fluid and crystallized intelligence {Jensen, 1973), Hypothesis I 
was not confirmed* 

HYPOTHESIS II 

Hypothesis XX .states that using two multitrait-multimethod matrices as 
described by Campbell and Fiske (1959), evidence of the convergent validity of 
each of the constructs of Level X and Level xX intelligence will be provided 
as follows; the intercor relations among the operationalizations of each of the 
two constructs in each matrix will be significantly greater than zero* 

Building a multitrait-multimethod matrix requires two kinds of Inforroationi 
an intercorrelation matrix of all the variables involved and the test-retest or 
internal consistency reliabilities for each of the variables* When reliabilities 
are not available, they may be omitted (Campbell & Fiske, 1959)* FACT0R3, a 
computer program maintained by the University of Wisconsin Academic iy^mputing 
Center, was used to generate the matrix of intercorrelations among, (I IS 
variables* Table 12 presents the values, type and sources of the liability 
coefficients used in constructing the multitrait**multim&thod matrica^* 

Xn presenting the multitrait'-mul timet hod matrices a set of abbreviated 
labels will be used for the variables* Table 13 presents the abbreviations 
employed* Two matrices were constructed using all 15 variables to assess the 
convergent and discriminant vedidity of the constructs of Level I and Level XX 
intelligence in the light of each of two possible sources of confounding method 
variance. For the first matrix the tasks were categorized by response mode— 
verbal versus nonverbal (see Table 3)* Table 14 presents the first multitrait- 
multimethod matrix* Following the conventions employed by Campbell and Fiske 
(1959), various parts of the matrix are referred to by special names, Xnter* 
correlations among operationalizations of the same construct which employ 
different methods are underlined. The underlined portions of the matrix 
are referred to as the validity diagonals, although they do not alwavs 
appear as diagonals in the matrix* High values in the validity diagonals 
represent agreement between attempts to measure the same trait through different 
measures, providing evidence of convergent validity* Values in parentheses along 
the diagonal of the matrix are the reliability coefficients* The inter-correlations 
among the operationalizations of different traits which employ the same method 
are referred to as heterotrait-monomethod blocks, and are enclosed by a solid 
line* The significance of these values will be dealt with under Hypothesis XXIf 
which tests the dif^criminant validity of the constructs* Xntercor relations 
between variables having neither trait nor method in common are enclosed by 
broken lines and are said to occur in heterotr ait-he teromethod blocks* The 
interpretation of these values is also reserved for Hypothesis ixx* 

Hypothesis It may now be restated as follows: the values in the validity 
diagonals will all be significantly greater than zero as determined by the use 
of risher'« to £ transformation* Of the 3 values in the validity diagonal 
for Level X^, all are positive and one is significant at the *01 level* Of the 
18 values for Level XI, all are positive, 12 are significant at the *0S level, 
and of these 9 are significant at the *01 level* Xn summary, one third of the 
values in the validity diagonal for the Level X construct and two thirds of the 
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TABLE 12 



TYPE AND SOUHCE OF RELIABILITIES IHCLDDED OM THB MAIN DIAGONAL 
OP THE MULTITRAIT-MULTIMETHOD MATRICES 





Variable 


Value 


'Type 


Source 



WISC-R Coding B 


.77 


Test*Retest 


Wechsler, 1974 


Paired-Associate Task 


.54 


Test*Retest 


Pilot Study 


Uncategorized Free 
Recall 


.41 


Test"Retest 


Pilot Study 


WlSC-R Digit Span 


a 






Raven's CPM 


.dO 


Test-*Retest 


Raven, 1965 


WISC'R Similarities 


.di 


Test-Retest 


Wechsler, 1974 


WISC-R Block Design 


.d5 


Test-Re test 


Wechsler, 1974 


Categorized Free 
Recall Z Index 


.74 


Test*Retest 


Pilot Study 


DSU Rhyming Fluency 


.59 


Test-Retest 


Pilot Study 


DSU Rhyifting Originality 


.63 


Test*Retest 


Pilot Study 


PPVT Raw Score 


.77 


Test*Retest Using 
Parallel Forms 


Dunn, 1965 


SRA Math Concepts 


.dO 


Internal 

Consistency (KR^qJ 


Thorpe, Le fever, & 
Haslund, 1964 


SRA Math Computation 


.87 


Internal 

Consistency (KR^q) 


Thorpe, Le fever, & 
Haslund, 1964 


Gates**MacGinitie 
Vocabulary 


.65 


Test-Retest Using 
Parallel Forms 


Gates & MacGinitie, 
1965b 


Gate s-MacGini tie 
Comprehens ion 


.63 


Test-Retest Using 
Parallel Forms 


Gates & MacGinitie^r 
1965b 



*No reliability is available for the forward portion of the wiSC-R digit span 
sxibtest* Test*retest reliability of the entire subtest is reported by Wechsler 
(1974) as ,74, 
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TABLE 13 

ABBREVIATIONS OP NAMES OP VARIABLES USED IN 
MULTITRAIT-MULTIMETHOD MATRICES 



Variable Abbreviation 



Operationalizations of Level 


I Intelligence 


WISC"'K coain9 » 


Coding 


Pdired** Assoc id tie Task 


FA 


uncaue^orxzcu r rce accaxj. 


17 DTI 


WISC~*R Digit Span 


DSP 


Operationa ligations of Level 


II Intelligence 


Raven *s CPM 


CPM 


WISC-R Similarities 


Sim 


WISC*-R Block Design 


BD 


categorized Pree Recall Z Index 


PRC 


DSU Rhyming Fluency 


DSU-F 


DSU Rhyming Originality 


DSU-0 


PPVT Raw Score 


PPVT 


SRA Math Concepts 


SRA-Cn 


SRA Math Computation 


SRA-Cm 


Gates-MacGinitie Vocabulary 


CM-Voc 


Gates-MacGinitie Comprehension 


GM-Cmp 
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TABLE 14 

MULTITRAIT-MULTIMETHOD MATRIX OP ALL FIFTEEN VARIABLES USING VERBAL VERSUS N(»IVERBAL RESPONSE MODE 



I Verbal Nonverbal 

Level I Level II Level I Leve _ l II 

PA FRU PSF Sim FRC DSU-F DSU-O PPVT SRA-Cn SRA-Cm GM-Voc GM-Cnrp Coding CPM BD 

Verbal 
Level I 

PA (.54) 

FRU .03 (,41) 

DSF .13 .01 ( ) 



Level II 



Sim 

FRC 

DSU-F 

DSU-O 

PPVT 



.12 
.02 
.04 
.01 
.00 



.13 .11 
,15 -.08 
.08 .11 
.00 .01 
.03 .12 



(.81) 

.02 (.74) 

.17 .04 (.59) 
-.09 .01 .26 (.63) 

.41 .03 .11 .04 (.77) 



TABLE 14 (contO 



Verbal 



Nonverbal 



Level I 



Level II 



Level I Level II 



PA FRU 



DSF 



SiJti PRC DSU-F DSU^O PPVT SRR-Cn SRA-Cin GH '- Voc GM"CmP Coding CPH BP 



SRA-Cn 


-•00 


.27 


.15 


.26 


.08 


.26 


.06 


.30 


(.80) 












SRA*"C»i 


• 16 


.25 


.06 


.15 


.05 


.19 


.01 


.11 


.65 


(.87) 










GM-Voc 


• 25 


.18 


.31 


.36 


.06 


.29 


.08 


.46 


.52 


.35 


(.85) 








GM-Cmp 


• 13 


.16 


.22 


.28 


.14 


.33 


.04 


.,43 


.49 


.40 


.76 


(.83) 






Nonverbal 




























Level I 
Coding ^12 




.08 


j 

1 .^04 


.17 


.22 - 


-.06 


-.07 


.12 


.20 


.13 


~r| 


(.77) 




Level 


II 




























CPH 


rTo9 

i 


.25 


.13 1 


.23* 


.12 


.22** 


.04 


.11 


.37** 


.30** 


.26** 


.24** 


.18 


(.80) 


BD 


1 .09 


.18 


1 

-.02 1 


.14* 


.04 


.15* 


.08 


.13* 


.18** 


.19** 


.07 


.20** 


.18 


.38 
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♦Validity diagonal entry significant at the ,05 levels 
**Validity diagonal entry significant at the ,01 levels 
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values in the validity diagonal for the Level n construct with respect to 
verbal versus nonverbed response mode are significemt at the ,05 level* 
Iliese results provide some evidence of the convergent validity of the construct 
of Level u intelligence, but not of the construct of Level I intelligence* 

A second matrix %fas constructed to assess the vedidity of the constructs 
of Level I and Level XI intelligence in the light of a second possible source 
of confounding method variance* The 15 variables were categorized by adminis- 
tration type, either group or individually, as indicated in Table 3* The 
multitrait-multimethod matrix for this second categorization is presented in 
Table 15* 

Of the three entries in the validity diagonal for Level I, all were 
positive but only one was significant* of the 28 values in the validity 
diagonal for Level XX, all but one were positive, 15 were significant at the 
*05 level, and of these 13 were significant at the «01 level* Once niore, some 
evidence to support the convergent validity of Level IX was provided, but little 
evidence to support the convergent validity of Level I was obtained* 

Since it was thought appropriate to factor analyze only the nine "purer** 
mefisures of Level X and Level XI intelligence, a second set of multitrait- 
multimethod matrices was constructed using only these nine '^purer** variables 
and the same method categorizations as before* The nine-variable matrix 
used to assess the convergent and discriminant validity of the constructs 
of Level I and Level XI intelligence %dth respect to verbal versus nonverbal 
response mode is presented in Table 16* Although the information presented in 
this table is included in Table 13, Table 16 %fas constructed to clarify the 
description of validity when using the nine **purer" variables* 

^e smaller multitrait-multimethod matrix employing response mode provides 
little support for the convergent validity of either Level I or Level xi* Of 
the three validity diagonal entries for Level X, all are positive, but only 
one is significantly greater than zero* Of the six entries in the Level XI 
validity diagonal all are positive, three are significantly greater than zero 
at the *05 level, and two are significant at the *01 level* In summary, no 
more than half of the entries in either validity diagonal differ significantly 
from zero* 

Table 17 presents the fourth and last multitrait-multimethod matrix, 
employing the group versus individual administration categorization and only 
the nine •'purer*' variables (see Table 3)* This last matrix also fails to 
provide strong evidence of the convergent validity of either X^evel X or Level 
II* Of the three validity diagonal entries for Level I, all are positive, but 
only one is significant* Of the four entries for Level II, all are positive 
but only two are significant* 

After examination of the four multitrait-multimethod matrices, it is 
concluded that Hypothesis II concerning the convergent validity of the construct*; 
is not supported with respect to either X^evel I or Level II intelligence* 
Even though substantial numbers of the correlations in the validity diagonals 
are statistically significant, the more important issue of psychological 
significance is not substantiated* The range of correlations in the validity 
diagonals of the four matrices for Level I is from *08 to *26, and the range 
of values for Level is from ,01 to *46* If correlations no greater than 
these can be obtained using independent methods to measure the same construct, 
the existence of the construct as a ccherent psychological entity is clearly 
called into question* 

In spite of the generally low intercorrelations atnong variables, the 
patterns evident in the correlation matrix appear reasonable* Correlations 
are generally positive, achievement tests are highly intorcorrelated^ and the 



TABLE 15 

MULTITRAIT-MULTIMETHOD MATRIX OP ALL FIFTEEN VARIABLES USING TYPE OF ADMINISTRATION 



Group Administration 



lEndividual Administration 



6^ 



CPM 

DSU-P 

DSU-0 

SRA-Cn 

SRA-Cm 

GM-Voc 

GM-Cmp 



Level I 



Level II 



Level I 



Level II 



Coding CPM DSU-P DSU-0 SRA-Cn SRA-Cm GM-Voc GM-Cmp PA frU DSF SiJti BD PRC PPVT 

Group 
Level I 

Coding (.77) 
Level II 



(.80) 

.22 (.59) 

.04 .26 (.63) 

.37 .26 .06 (.80) 

.30 .19 .01 .65 (.87) 

.26 .29 .08 .52 .35 (.85) 

c24 .33 .04 *49 .40 .76 (.83) 
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TABLE 15 {contJ 



Group Administration 



Individual Administration 



Level X 



Level XX 



Level X 



Level XX 



Coding CPM DSO-F DSO-0 SRA-Cn SRA-Cm GM-Voc GM-Cmp PA PRO DSF Sijn BO PRC PPVT 

Individual 
Level X 



PA 


.12 


1 .09 


.04 


-.01 


-.00 


.16 


.25 


.13, 


(.54) 






PRO 


.20** 


j .25 


.09 


.00 


.27 


.25 


.18 


.16 1 


.03 


(.41) 




DSF 


.08 


|.13 


.11 


.01 


.15 


.06 


.31 


.22J 


.13 


.01 


( ) 


:.evel XX 
























Sim 


.04 


.23^* 


.17** 


-.09 


.26** 


.15** 


.36** 


.28** 


.12 


.13 


.11 


BD 


j .18 1 


•38** 


•15* 


.08 


.18** 


.19** 


.07 


.20** 


.09 


.18 


-.02 


FRC 


.17 


.12_ 


.04 


• 01 


.08 


.05 


.06 


.14,* 


.02 


.15 


-.08 


PPVT 


[ -.07 j 


.11 


.11 


.04 


.30** 


.n 


.46** 


.43** 


.00 


.03 


.12 



(.81) 
.14 (.85) 
.02 .04 (.74) 
.41 .13 -.03 (.77) 



* Validity diagonal entry significant at the .05 level. 
**Validity diagonal entry significant at the .01 level. 
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TABIE 16 



MULTITFAIT-MULTIMETHOO MATRIX OP NINE VARIABLES 
USIMG VERBAL VERSUS KOWERBAL RESPCNSE MODE 



Verbal 



Nonverbe ' 



Level I 



Level II 



Level I Level II 



Verbal 
Level I 



PA FRU DSP Sim PRJL PE>VT Coding CPM 



PA 


(•54) 








FRU 


• 03 


(•41) 






DSF 


• 13 


.01 ( ) 






Level II 










Sim 


• 12 


.13 .11 


(•81) 




PRC 


• 02 


•15 -.08 


•02 (.74) 




PPVT 


• 00 


•03 ^12 


.41 .03 


(•77) 


Nonverbal 










Level I 










Coding 


• 12 


•26** •00 


p04 .17 


-.07 j 


Level II 








CPM j -09 


•25 •131 


• 23,**. 12^ 


• 11 


BD 


• 09 


•IB -•02 


•14* -04 





BD 



(.77) 

.18 
.18 



(.80) 

.38 (.85) 



* Validity diagonal entry significant at the .05 level. 
** Validity diagonal entry significant at the .01 lovel. 



TABLE 17 



MULTITRAIT*MULTIMETHOD MATRIX OF NINE VARIABLES 
USING TYPE OF ADMINISTRATION 



Group 

Administration Individual Administration 



Level I Level II Level I Level n 



Coding CPM PA frU DSF Sim BD frC PPVT 



Gro up 
Level I 

Coding 
Level II 

CPM 
Individual 
Level I 

PA 

FRU 

DSF 

Level II 



(•77) 



>ie I 



(.80) 



.12 
.26** 
.08 



.09 



26** .25 I 



08 j .13J 



(.54) 
.03 (.41) 
.13 .01 ( ) 



Sim 


1 .04 1 


.23** 


.12 


.13 


.11 


(.81) 








BD 


1 f 


.38** 


.09 


.16 


■^.02 


.14 


(.85) 






FRC 


.17 


.12 


.02 


.15 


-.08 


.02 


.04 


(.74) 




PPVT 


|-.07 j 


.11 


.00 


.03 


.12 


.41 


.13 


.03 


(.77) 



* Validity diagonal entry significant at the .05 level. 
** Validity diagonal entry significant at the .ol level. 
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correlations of the various WISC-R subtests with the CPH^ the PPVT and the 
four achievement measures are reasonable ^ given that an individual subtest of 
the WISC-R would not be expected to correlate as highly as full scale wiSC^R 
IQ with these measures^ It is expected that if all the WISC-R subtests used 
in this research were combined^ the resultant measure would correlate more 
highly with other IQ and achievement tests than did any individual subtests 
These observations support the conclusion that the patterns evident In the 
correlation matrix are reasonable^ even though the magnitudes of the correla- 
tions are generally low^ 

It must be noted that some of the reliabilities presented in the matrices 
and in Table 12 are low^ and that none were obtained on the same sample ^ich 
provided the intercor relations^ Hence^ if problems occurred with these t<?st 
administrations^ or if the variables employed were in fact unreliable^ an 
accurate assessment of the validity of the constructs may not be possible^ 
There are several reasons for not having computed reliabilities of the variables 
using the same sample which yielded the intercorrelations* First of all^ data 
on achievement test scores obtained from children*s school records included only 
total raw scores^ It was impossible to obtain item response data^ Second^ tests 
such as the DSU rhyming task and the WISC-R Coding B subtest are speeded^ making 
internal consistency measures inappropriate^ In these instances^ pilot tests 
were conducted employing appropriate samples to obtain test-retest reliabilities 
^ich were then inserted in the matrices^ Thirds several more of the measures 
such a?, the categorized and uncategorized free recall tasks do not have separate 
items per se^ precluding the computation of internal consistency reliabilities. 
In these instances ^ also^ pilot tests using children of an appropriate age were 
conducted to establish test-retest reliabilities for use in the multitrait-multi^ 
method matrices^ The fourth reason for using reliability information from other 
sources was that of administrations requiring the establishment of a basal and 
a ceiling levels as is done with the PPVT and all of the WISC-R subtests employed 
except Coding Typically^ no subject may receive all of the items on a test 
of this type^ again necessitating the use of a test-retest reliability in this 
context. In the light of these considerations ^ the conclusion drawn concerning 
the convergent validity of the constructs must be interpreted with caution^ 

HYPOTHESIS III 

Hypothesis III states that by using two multitrait-multimethod matrices 
as described by Campbell and Fiske (1959) r evidence of the discriminant validity 
of each of the constructs of Level I and Level II intelligence will be provided 
as follows: in each matrix^ the correlation between any two operationalizations 
of the same construct will be higher than either of their correlations with any 
operationalization of the other construct* To test this hypothesis^ values on 
the validity diagonals are compared first with values in the same row or column 
enclosed in the heterotrait-heteromethod blocks (indicated by broken linos) and 
then with the values in the same row or column enclosed in the heterotrait* 
ronomothod blocks (indicated by solid lines). Values in the validity diagonals 
which arc higher than values in the same row or column enclosed by broken lines 
(heterotrait-heteromethod block) indicate that a verbal response mode test and 
a nonverbal resfK:>nse mode test of the same construct correlate more highly than 
a verbal respon.»e mode test and a non-verbal response mode test of different 
constructs* Values in the validity diagonals which are higher than values in 
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the same row or column enclosed by solid lines (iaonotrait*heteromethod block) 
indicate that a verbal response mode test and a nonverbal ^^esponse mode test 
of the same construct correlate more highly than a test of Level X snd a test 
of Level II which employ the same response mode* A less stringent test of 
discriminant validity, also implied by Hypothesis' III, is that the values in 
the monotrait-monomethod triangles (neither enclosed nor underlined) also be 
greater than values lying in the same row or column and enclosed by either 
broken or solid lines* This means that two measures of the same construct 
employing the same response mode should correlate more highly with each other 
than with measures of the other construct, regardless of response mode en^loyed* 
\ For the matrix employing verbal versus nonverbed response mode and all 
15 variables, presented in Table 14, 304 comparisons of values are implied* 
For 70 of these comparisons it is predicted that two measures of Level I will 
correlate more highly with each other than with measures of Level II* Of these 
70 comparisons less than half, only 31, are in the predicted direction* For the 
remaining 234 comparisons it is predicted that two measures of Level II will 
correlate more highly with each other than with measures of Level I* Of these 
234 comparisons just under two-thirds, 154, are in the predicted direction* In 
summary, tests of Level I tend to correlate more highly with tests of Level II 
than with each other, and tests of Level II also tend to correlate more highly 
with other tests of Level II than with tests of Level I* This finding could 
be explained in paxrt by the lower reliabilities of the Level I tests* Results 
of these 304 comparisons fail to support the discriminant v£d.idity of the 
constructs* 

Upon inspection of the matrix, no salient method effect appears either, 
indicating that performance on neither Level I nor Level II tests is affected 
by response mode (verbal versus nonverbal)* ^ method effect would be indicated 
by higher values in the heterotrait^^heterom^thod blocks, where the median corre- 
lation was *13, and by higher values in the roonotrait-monc«nethod triangles, 
where the median correlation was .16, than in the validity diagonals, where 
the median correlation was *1B* 

It might be argued that an effect of response mode exists only vdthin 
Level I or within Level II* In looking for a method effect within Level I, the 
intercor relations among tef.ts of Level I employing the same response mode are 
compared with those employing different response modes* The median correlation 
within the Level I monomethod blocks is *03 and the median correlation within 
the Level I heteromethod blocks is *12* This suggests that there is no effect 
of response mode within Leirel I* Within T^evel II the median monomethod corre- 
lation is *19, and the median heteromethod correlation is *17, again providing 
little evidence that type of responci* mode (verbal versus nonverbal) affects 
performance* 

At this point results concerning the discriminant validity of the constructs 
as tested by the second 15 variable multitrait-multimethod matrix will be 
presented* The matrix being examined (see Table 15) employs a method classifica* 
tion of group versus individual administration* For this matrix 391 comparisons 
of values are implied* For 87 of these comparisons it is predicted that two 
measures of Level I will correlate more highly with each other than with measures 
of Level II* Of these 87 comparisons only 40, less than half, are in the 
predicted direction* For the remaining 304 conparisons it is predicted that two 
measures of Level Ii will correlate more highly with each other than with 
measures of Level I* Of these 304 comparisons 2X5, or 71 percent are in the 
predicted direction* 
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In summairy, tests of Level II are once again seen to correlate more 
highly with all the other variables than tests of Level I do* Again this 
result could be due to the higher reliabilities of the Level II tests* 
Although intercorrelations among tests of Level II are higher than intercorre- 
lations between Level I and Level II tests in 71 percent of the cases, it 
should be noted that the magnitudes of most correlations in the matrix are 
so low that evidence of discriminant validity would be weak even if all 
coir^arisons were in the predicted direction* 

There appears to be no salient metliod effect, indicating that type of 
administration failed to affect performance on either Level I or Level II 
tests* A method effect would be indicated by higher values in the heterotrait-* 
monomethod blocks, where the median correlation was *12, than in the hetero^ 
trait*heteromethod blocks, where the median correlation was *17* Another 
indication of a method effect would appear if there were higher values in the 
monotrait-monomethod triangles than in the validity diagonals* The median 
correlation for values in the monotrait-monomethod triangles was *23, as 
compared to the median correlation of *14 in the validity diagonals* As 
irdicated, there is little support for a method effect* Looking more closely 
at the effect of type of administration within Level I only, the median 
correlation within the Level I heteromethod blocks is *12, while the median 
correlation within the Level I monomethod triangle is only *03* If the median 
correlation within the Level I tests using the same type of administration were 
higher than the median correlation of Level I tests using different types of 
administration, then there would be evidence of a method effect* As the results 
indicate there is no support for a method effect within the Level I tests* The 
same sets of correlations are coitipared for the Level II tests* The median 
correlation within the Level II monomethod triangle is *26 while the median 
correlation within the Level II heteromethod blocks is *13, giving some support 
for a method effect* Once again results nust be regarded cautiously, given the 
low magnitudes of correlations involved* 

The next few paragraphs will review the results concerning the discriminant 
validity of the first of the nine-variable multitrait-multimethod matrices* In 
constructing the first of these smaller matrices the tasks were classified 
according to response mode (verbal versus nonverbal) as indicated in Table 3* 
The matrix is presented in Table 16* For this nine-variable matrix 85 compari- 
sons are iinplied* For 39 of these comparisons it is predicted that two measures 
of Level I will correlate more highly with each other than with measures of 
Level II* Of these 39 comparisons 25, or 64 percent, are in the predicted 
direction* For the remaining 46 comparisons it is predicted that two measures 
of Level II will correlate more highly with each other than with measures of 
Level I* Of these 46 comparisons just over half, or 24, are in the predicted 
direction* In summairy, evidence of discriminant validity provided by the third 
matrix is very weak* Once more the magnitudes of the correlations reported are 
too low to support any strong conclusions* However, the uniformity of the 
correlations across the various parts* of the matrix argues against the existence 
of the constructs* 

The search for a method effect as it was carried out for the first two 
matrices would be ledundant, as only the set of Level II tests has been changed. 
Accordingly, inspection of the matrix with regard to the effect of response 
mode was curtailed to only an examination of the Level II tests* Within the 
Level II monomethod blocks the median correlation was *21, wnile the median 
correlation within the Level II heteromethod block was *13, providing minimal 
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support for an effect of response mode within the *'purer" measures of Level 
II* 

The last matrix, presented in Table 17, is used to assess the discrim- 
inant validity of the nine ''purer*' measures employing the method classifica-^ 
tion of type of administration (group versus individual). For this matrix 85 
comparisons of values are implied* For 33 of these comparisons it is predicted 
that two measures of Level I will correlate more highly with each other than 
with measures of Level il. Of these 33 comparisons only 17, or just over 
half, are in the predicted direction* For the remaining 52 comparisons it is 
predicted that the two measures of Level II will correlate more highly with 
each other than with measures of Level I* Of these 52 comparisons 35, or 66 
percent, are in the predicted direction* There is virtually no support for 
the discriminant validity of the constructs given these resul1;s* 

An examination of any possible effect of type of administration (group 
versus individual) within the set of **pure" measures of Level II intelligence 
employed in the fourth matrix gave no evidence of^py method effect. Within 
Level II the median roonomethod correlation was *09, while the median correla-^ 
tion across methods was *ld* 

In summary, the discriminant validity of the Level I and Level II 
constructs is not si^ported by the four multitrait-^multimethod matrices, and 
the results predicted in Hypothesis III are not obtained* Whether the lack of 
con.tirmation is attributable to the nonexistence of coherent psychological 
traits or due to the inclusion of improper operationalizations of Level I and 
Level II is unclear* One conclusion that may be drawn from inspection of each 
of the matrices is that the correlations between measures of Level I and 
measures of Level II tend to be higher than the in tercor relations among measures 
within Level I. This suggests that the operationalizations of Level I chosen 
for use in this study may not be performing as expected* These results may be 
explained in part by differences in the types? of performance elicited in each 
Le/el I test* If the items or tasks presented in the various measures of 
Level I intelligence are amenable to solution by cognitive operations or processes 
other than rote learning, then some children may have employed some cognitive 
processes in solving Level I tests which are shared with the Level II tests* 



SUPPLEMENTARY ANALYSIS 

The results presented in the previous sections focused on the existence 
of the constructs* This section will focus on the relationship of each of the 
four measures of achievement to each of the other tests administered* 

Table 18 presents the Pearson product-^moment correlations of each of tb'3 
four achievement measures with each of the rauaining 11 variables. Thirty of the 
44 correlations are significant at an alpha, level of £ < ♦OS, and of th^«;e 26 
are significant at an alpha level of £ < ♦Ol* These correlations were computed 
on the entire sample of 221 children* 

The high number of significant correlations is not surprising, and supports 
tho contention that the study of Level I and Level II intelligence as operation- 
aliped by the variables included in this study is of relevance to the school 
environment* Although the magnitudes of the correlations l>reseiited in Table 18 
are not high, some positive relationship is evidenr between scholastic achieve- 
ment measures and each of the other variables, \vitn the exception of the DSU 
originality score* 
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TABLE 18 

PEARSON PRODUCT-MOMENT CORRELATIONS OF ACHIEVEMENT MEASURES 
WITH EACH Of THE REMAINING VARIABLES 





Achievement Measures 


Variable 


SRA Math 
Concepts 


SRA Math 
Computation 


Gates- 
MacGinitie 
Vocabulary 


Gates- 
HacGinitie 
Comprehension 


WISC-R Coding B 


- *120 


*202** 


*127 


*191** 


Pdired Associate Task 


-*004 


*155* 


.249** 


*131 


Uncategorized Free 
Recall 


.270** 


*245** 


*179** 


*157* 


WlbC K uigm opa^n 


*150* 


*055 


.^05** 


*220** 


Raven's CPM 


*365** 


.295** 


.256** 


*236** 


WISC-R Similarities 


*264** 


*148* 


.357** 


*278** 


Wisr-K Block Design 


asi** 


an** 


.012 


*197** 


Categorized Free 
Recall Z_ Index 


*084 


*046 




.1A2* 


DSU Rhyming Fluency 


*255** 


.194** 


*287** 


.328** 


DSU Rhyming Originality 


*063 


.001 


*080 


*038 


PPVT R^w Score 


*302** 


.105 


.459** 


*425** 



* gi < .05 

** £ < /n^ 
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CONCLUSIONS 

Tests of Hypotheses I, II, and HI have failed to support the existence, 
convergent validity, or discriminant validity of the constructs. Therefore, 
three alternative conclusions must be considered* In Chapter V, each of the 
following alternatives will be discussed: (i) The opera tionalizat ions may have 
been inappropriate, (2) the theory from which the constructs arose may be in*- 
accurate, or (3) some aspect of the experimental procedures or methodology may 
have precluded finding the expected results. 



DISCUSSION 



Three possible explanations will be considered for the lack of support 
for the hypotheses as stated^ First, the adequacy of the operationalizations 
will be discussed. Second, methodological weaknesses will be examined. Third, 
the results concerning each of Hypotheses I, II, and III will be considered 
in relation to the constructs of Level I and Level II intelligence and alterna- 
tive theoretical frameworks. Finally^ educational implications will be 
presented . 



ADEQUACY OF OPERATIONALIZATIONS AND METHODOLOGY 

Discussion of the adequacy of the operationalizations and the methodo** 
logical weaknesses of the study might typically be placed in a section entitled 
"critique and limitations." The present organization was chosen to clarify 
the interpretation of the study as a construct validation, where failures of 
operationalizations or e}(perimental procedures may in th^selves be of conse* 
quence in evaluating the validity of the constructs. 

Ade<^uacy of 0£erationalizatlons 

The definitions of both Level I and Level II intelligence are in terms 
of internal processes. Those internal processes must be logically inferred 
on the basis of the characteristics of the measures used, e.g., when only one 
trial on the PA task is administered, it is assumed that the amount of mediation 
possible is quite limited, or when obvious categories are provided in the 
stimulus ntaterials for a free recall task# there is ample opportunity for the 
application of mnemonic strategies to facilitate recall. While it is clear 
that some transformation or manipulation of the input is required to solve the 
Raven's CPM, for example, it is difficult to guarantee that the internal 
processes elicited in each subject by an intended operationalization of Level I 
intelligence will not involve any transformation or manipulation of the input. 
Given that so much. of Jensen^s definitions is concerned with the specification 
of internal processes and so little discussion of observable behaviors? is 
provided, it is difficult to assure the adequacy of the operationalizations 
employed. As indicated in Chapter IV, there is evidence that some of the 
mea*;ures intended as operationalizations of Level I intelligence elicited 
Level II processes in at least some of the children tested. 

76 



63 



64 



Adequacy of Experimental Procedures and Methodc ,ogy 

Several methodological weaknesses may have contributed to the failure 
to confirm Hypothesis One problem was that of low reliabilities on 
several of the instruments used. Such reliabilicies preclude high inter- 
correlations among the various operationalizations of each construct, affecting 
both the factor analytic solutions and the multitrait-multimethod matrices 

A second problem was that the correlations of the PA test and Raven's 
CPM with the other variables may have been attenuated due to the levels of 
difficulty of these two tasks « The mean and standard deviation of the PA test 
indicated little variation in performance, and sorae ceiling effect was 
evident in the CPMp Again, these problems may have reduced the probability of 
finding support for the constructs, 

A third factor which may have resulted in somewhat lower intercorrela^ 
tions than otherwise was the wide range of testing conditions encountered in 
the various schools. It was not always possible to secure facilities for quiet 
and uninterrupted individual test administrations. While data collected under 
adverse conditions may have attenuated the obtained correlations, testers were 
carefully trained in advance and supervised during the testing to ensure the 
greatest possible uniformity in test administrations, 

ADEQUACY OF THE THEORIES IN WHICH THE CONSTRUCTS OF LEVEL I AND LEVEL II 
INTELLIGENCE ARE EMBEDDED 

This paper is oriented toward the substance and methodology most 
familiar to the individual differences psychologist. However, some recent 
findings by cognitive and developmental psychologists also provide support 
for the interpretations presented. 

H ypothesis I 

In thQ light of the probl^s of opera tionalizat ion and methodology 
discussed abovs, inferences from this research must bo made with caution. None-* 
theless, the possibility remains chat the failure to confirm Hypothesis I 
implies that Level I and Level II are not distinct abilities- 

Six-;Factor Solution * If Level I and LeveiL II intelligence indeed 
represent two independent types of intelligence, then factor analysis of a 
suitable battery of tests should yield factors corresponding to these two 
ccmstructSp All of the tests in the battery, v/ith the possible exception of 
the DSU rhyming task which loaded on the creativity factor, should, acco; iing 
to Jensen's (1969) theory be composed of some combination of Level I and Level 
II intelligence p The relative proportions of Level I and Level II intelligence 
required by the various tests should vary, even though no test would be expected 
to be a pure measure of either one* The creativity test might be expected to 
be different from the others, in that although creativity is related to intelli- 
f/ence it clearly involves other factors as well CCronbach, 1970)- 

It was predicted that, aside from the creativity test scores, three 
factors would energe- Not only were five other factors found, but four 
anomalies distinguished the obtained factor structure from the predicted 
structure. First? all operationalizations of Level I intelligence did not 
load on the same factor. Second, all operationalizations of crystallized 
Level II intelligence did T^ot load on the same factor- Third, all operational- 
izations of fluid Level IX intelligence did not load on the same factor. 
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Fourth, some operational! sat ions of Level I intelligence and some opecation- 
alisations of Level II fluid loaded significantly on the same factor. 
Subject to the limitations of this stud/, these anomalies require either the 
introduction of new constructs or modifications of existing ones* The 
incorporation of still more constructs, or types of intelligence, to account 
for the addition il factors obtained is not acceptable* Cronbach and Meehl 
(1955) caution that any such modification (e*g*, splitting a concept into 
two or more portions) must be tested on a different body of data prior to 
acceptance, to avoid the danger of a posteriori rationalization* Furthermore, 
the introduction of additional construct^ is not sufficient to explain the 
results of the factor analysis of all IS variables* Mathematical ability, 
language ability, abstract reasoning using figural content, and creativity 
might all be interpreted as types of Level II intelligence, but the variables 
loading significantly on the mnemonic facility factor include proposed opera- 
tional i 2a t ions of each of Level I and Level II, precluding the interpretation 
of the iactor as a type of either Level I or Level II intelligence* In the 
light of these results. Level I intelligence. Level II fluid, and Level II 
crystallized intelligence may not be valid constructs* 

Since the results of the first factor analysis d^ not correspond to the 
prediction in Hypothesis I, alt^irnative explanations for the obtained factor 
structure will be considered next* 

It might be expected that the factor structure obtained in the first 
analysis would correspond to the predictions of one or more of the multiple 
factor theories of intelligence reviewed in Chapter II* No unitairy factor 
appeared which could be interpreted as corresponding to Spearman's "G" , and, 
while Cattell's two-factor theoiry might account for the six factors, explana- 
tions in terms of specific content, etc* would have to be sought to explain 
the fracturing of each of his factors of fluid and crystallised mental abilities* 
Five of the six factors obtained in the present study might be interpreted as 
representing five of Thurstone's (1938) primary mental abilities- The factor 
labeled abstract reasoning using figural content resembxes Thur^tone^s spatial 
ability (s) t short term rote memoiry corresponds to Thurstone's memory (My, 
mathematical ability corresponds to number (n) f language ability corresponds 
to verbal (v) , and creativity resembles word fluency (W) * The mnemonic facility 
factor, however, does not correspond to either of Thurstone's two remaining 
abilities, reasc.iing (r) and perceptual speed (P) * While Thurstone's theory 
provides a partial interpretation of the data, most of the six factors obtained 
are so test-specific that the evidence provided in support oi any theoretical 
interpretation is weak* Only two tests loaded significantly on five of the 
six factors* To assess the adequacy of Thurstone's cheory to explain the results 
obtained, additional research employing many more measures would have to be 
conducted* None of the later intelligence theories, including Guilford*s 
U967) structure of intellect model, provide any better explanation of the six 
factors. 

The mnemonic facility factor is explained by none of the th'Sories 
reviewed. The variables loading significantly on mnemonic facility include 
intended operationalizations of each of Level I and Level II intelligence* 
This ftictor foreshadows a problem with the concept of a distinct memory factor; 
it, dirficult to maintain the construct of Level I intelligence when operation- 
al!/. jt ion: of Level I intell iqeiicr !oad on factors presumably representing 
t.yrjLVi of Level IT intol i igenco , 
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The mnemonic facility factor is distinctive in several respects* No 
analagous factor appears in the work of any of the major intelligence theorists, 
and the argument presented in Chapter IV for the labeling of the factor 
employed terms and drew upon literature not typically encountered in individ- 
ual differc^nces psychology* The free recall paradigm is not usually employed 
in individual differences psychology, and the two free recall tests in the 
present study both load more highly on mnemonic facility than on any other 
factor, suggesting a possible explanation for the failure of intelligence 
theorists to have described this factor* 

The generation or modification of mnemonic strategies is an example of 
a more general feature of human thought processes* Given a novel problem- 
solving situation, an individual will invent or adapt idiosyncratic strategies 
to facilitate performance (Hagan, 1972). Flavell (1970) describes such 
strategies to facilitate performance as "mnemonic mediation*" Such mediation 
is characterized as **a planful, instrumental, cognitive act, akin to problem- 
solving behavior (Flavell, 1970, p* 208)**^ The retrieval of information may 
be regarded as a particular type of problem to be solved, and mnemonics are a 
particular class of strategies which facilitate the solution of the problem of 
remembering* In addition to the free recall tests and the WISC-R Coding B 
subtest, all of which loaded on the mnemonic facility factor, four other 
measures included in the battery reflect a child*s p<arformance in novel problem- 
solving situations where skills or rules required fcr solution are not taught 
in school* These are the PA test, WISC-R digit span, WISC-R block design and 
Raven's CPM* The PA test and WISC-R digit span were designed to discourage 
strategizing, as discussed in Chapters III and IV* Miller, Galanter, and 
Pribram (1960, p* 136) state that "in tests of immediate memory * * * subjects 
seldom try any mnemonic tricks— with only one rJ^^sentation of the material, 
there is little time to develop a Plan [for remembering] and little need of it*" 
The number of items to be recalled in each of these tests, up to eight pairs 
of pictures or up to nine digits, are within the + 2" units suggested by 
Miller (1956) as the limit to the capacity of immediate memory, which also 
suggest*; that mnemonic strategies should not be required for successful per- 
formance on these two tcists* The remaining two novel problem- solving situation*; 
Raven's CPM and the WISC^R block design subtest, have been described as 
requiring complex reasoning strategies (Wech<5ler, 1949: Glasser & Zimmerman, 
1967 r Raven, 1965)* The perceptual factors involved in the performance of 
these tests as well as the different nature of the strategies required for 
successful performance distinguish thfise tests from the tests which loaded on 
the mnemonic facility factor, and may explain the appearance of the factor 
labeled abstract reasoning using figural content* The skills required for 
successful performance on the DSU Rhyming test, WISC-R similarities, PPVT, 
and the four tests of scholaF>tic achievement are much more likely to have been 
taught in school, and these tests are not characterized a^ novel problem- 
solving situations* 

Three-Factor Solution ^ Since the first factor analysis failed to support 
Hypothosif3 I as stated, an additional analysis not implied in HyjxDthesif; I was 
performed in an attempt to find support for the existence of Level T and Levol I 
intelligence* The rationale, defscriptlon, and discussion of the Fiecond factor 
analysis ^ro provided below* 

in con-^ijeration of the iJo:»j;ibJo madoquaciei; of tho operationaliz^j- 
tions employed in this study, and in the light of tne ad hoc nature of Jenson*^; 
(1973) employment of Cattell's constructs, it was decided to attempt a valida- 
tion of the constructs of Level I and Level II intelljcjence as originally 
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proposed, using only measures which clearly corresponded to Jensen*s (1969) 
definitions of the constructs and/or which had been employed by various 
researchers* Nine variables were included in the second factor analysis* 
Using these nine "purer" measures, a three-factor solution was obtained, 
which failed to validate the tw-factor theory of intelligence (see Chapter 
IV)* 

The tJiree factors obtained In the second analysis, described in Chapter 
IV, were labeled strategy usac;^, verbal intelligence, and short term rote 
memory* The short term rote memory factor was also found in the first 
analysis* The verbal intelligence factor corresponds exactly to the language 
ability factor found in the first analysis, except that two of the four 
variables with significant loadings on language ability were not included in 
the second factor analysis* The strategy usage factor in the second analysis 
includes exactly those variables which loaded on the mnemonic facility factor 
and on the factor labeled abstract reasoning using figural contents The 
uncategorized free recall test, which loaded marginally on the mnemonic 
facility factor in the first analysis, loaded significantly on strategy usage 
in the second analysis* Both of the variables which loaded on the short term 
rote memory factor were intended as opera tionalizat ions of Level X intelligence^ 
and both of the variables loading on verbal intelligence were intended as 
operationalizations of Level XX intelligence* However, two of the four opera- 
tionalizations of Level I intelligence and three of the five operationaXiza-- 
tions of Level xi intollicjence loaded significantly on the factor labeled 
strategy usage* These included the uncategorized free recall test, intended 
as an operationalization of Level X, as well as the categorized free recall 
test and the CPM, both chosen to operationalize Level XX, Thus^ the strategy 
usage factor does not correspond to either Level X or Level ix intelligence* 

Because the obtained factor structure failed to support the existence 
of the constructs of Level X and Level XX intelligence, alternative oxplana-^ 
tions of the results ot the second factor analysis will be considered^ 

None of the major intelligence theorists describe a factor, such as 
strategy usage, which saturates tests of both complex reasoning and memory* 
The factor cannot be equated to Spearman's '*G", becaus^a it is distinct from 
vtarbal intelligence as measured by the WXSC-R similarities subtest and the 
PPVT* Strategy usage may appear to correspond to Thurstone*s reasoning (R) 
factor, but that factor is characterized as involving logiccl reasoning, which 
docs not appear to be required for performance on the free recall and coding 
tests* The failure of intelligence theorists to report such a factor may be 
duo in part to the factor *s reliance upon tests more frequently used in e^g^eri-^ 
mental psychology than in the study of individual differences* Even Cronbach*s 
(1970) spectrum for comparing tests of scholastic aptitude or general ability 
fails to accomodate such experimental tasks as the PA test or the two free 
recall tests* This is significant in that Cronbach*s spectrum is atheoretical 
and locates a wide variety of tests along a continuum ranging from those 
requiring maximum training to thos^ requiring maximum adaptation or transfer. 
It therefore gives little guidance for interpreting the strategy usage factor* 

Given that intelligence theories have not frequently dealt with oxperi- 
mental tasks, it is useful to turn toward the body of psychological litera- 
ture which contends that heuristics or mnemonics are critical processes 
necessary tor organizing and retrieving information. Some of this literature 
was tliscussed with reference to the mnemonic facility factor which emerged in 
the 5ix-factor solution. 



A posteriori, all of the five tests which loaded on the strategy usage 
factor may logically be shown to ho similar in an essential way. Each requires 
the acquisition of heuristics, mnemonics or tricks to make the learning task 
easier* Each requires the formulation or acquisition of a rule, procedure, 
or method of organizing information to facilitate performance, rather than the 
application of previously acquired information* 

It is reasonable to suppose that this requirement for the adaptation or 
generation of novei strategies in approaching these five tests might account 
for the emergence of the strategy usage factor* Although not all researchers 
have employed the terms "strategy'* o>: "heuristic" in their work, many processes 
facilitative to problem solving may be regarded as examples of the employment 
of strategies* These processes include the use of mnemonic mediators (Flavoll, 
1970) J verbal rehearsal of strings of words (Flavell, 1970)? verbal mediation 
hypothesis (Spiker, Gerjuoy, & Shepard, 1956; Stevenson & McBee, 1958; Reese, 
1961)? typGS of strategies documented in probability learning (Stevenson fi 
Weir, 1963); selective attention for separating task-^relevant and task-irrele*- 
vant aspects of a situation (Hagan, 1972); coding, labeling, and categorizing 
(Maccoby & Hagen, 1965)? hypothesis generation and testing (Bruner, Goodnow, £t 
Austin, 1956); and win-stay, lose-shift strategies found in the study of learn- 
ing sets (Beman, Bane, & Bahow, 1970)* These various types of mediators, 
strategies, heuristics, etc* may all be described as involving "planfulness," 
i*e* engaging in some activity in the anticipation of improving performance 
(Flavell, 1970)* Hagan (1972) alludes to this generalization when he states 
that rehearsal strategies will be implemented only when the subject has a plan 
indicating that it will be useful to do so* The importance of plans, strategies, 
heuristics, etc* is emphasized by Miller, Galanter and Pribrum (196v^) in nheir 
book Plans and the Structure of Behavior * 

In smmnary, it is reasonable to suppose that children more facile in 
developing novel approaches to new problems will do better on the WISC-R 
Coding B subtest, categorized and uncategorized free recall tests, the vriSC-R 
block design subtest, and Raven*s CPM* 

Given that plans and strategies are central to performance on such a wide 
variety of psychological tasks, why didn't all of the tests load on the strategy 
usage factor? As discussed with reference to the six-factor solution, the two 
tests which loaded on the short term rote memory factor were specifically 
designed to discourage strat^gizing, and the immediate recall of short lists 
of stimuli should not require recoding for successful performance* The two 
tests which loaded on the verbal intelligence factor, the wiiC-R similarities 
subtest and the PPVT, may require strategies for successful performance, but 
these tests are much less novel in nature and the requisite strategies are much 
mor*; likely to have been taught in school* Thus, performance on these tests may 
be less dependent upon the child's facility in developing strategies in new 
situations* 

Hypothesis II 

The discussion of results concerning Jiypochesis ii will be brief* In 
testing this hypothesis jt is possible to determine tho appropriateness of the 
constructs of Level I and LevQl 11 intelligence by examining the agreement 
amonsi operationalizations of each construct vvhich are specified in advance* 
This approach is in opposition to that of the factor analytic technique, where 
any result is potentially possible and the psychologist must attempt to make 
sense of whatever factors emerge. 
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The two matrices constructed using all 15 variables and employing 
verbal versus nonverbal response mode and group versus individual administra* 
tion as method classifications gave marginal support to the convergent validity 
of Level II, but little support to the convergent validity of Level i* The 
two matrices employing only the nine ^^purer** measures and the same method 
classifications failed to substantiate the convergent vedidity of either 
Level I or Level II intelligence^ 

If in fact the various tests included in the battery were completely 
unrelated, some low negative and some low positive correlations would have been 
expected* As indicated in Chapter IV, the correlations between variables 
representing attempts to measure the same construct by different methods r^ged 
from *08 to *26 across the four matrices for Level I and from .01 to a^;ross 
the four matrices for Level II. The fact that all of the values in the validity 
diagonals of the four matrices were low and positive supports the contention 
that the various operationalizations of each construct do have some variance in 
common, but not enough to be of great psychological interest* 

In the light of the factor analytic results discussed with reference to 
Hypothesis I, the findings concerning the convergent validity of the constructs 
are not surprising* Little evidence for the convergent validity of Level I was 
obtained, suggesting that the construct as defined and operationalized is not 
a coherent psychological entity* 

The matrices employing all 15 variables gave more support to the convergent 
validity of Level ii than the matrices employing only 9 variables, indicating 
that the evidence for the convergent validity of Level II in the larger matrices 
depended primarily upon the 6 variables which were dropped to form the set of 
nine "purer" measures* These 6 variables were least defensible as operationali- 
zations of Level II intelligence* 

Hypothesis HI 

T}iG discussion of the results concerning Hypothesis m will also be 
brief* Campbell and Fiske (1959) pointed out that the convergence of indicators, 
i*e*, positive correlations among different types of measures, is insufficient 
to substantiate a construct* Some distinction between a given construct and 
other constructs, as evidenced by low correlations between measures of the 
different constructs, is also required* Cronbach (1972) derives the same require* 
ment from considerations of parsimony* Difterent scientific names should not 
be applied to the same entity or to two constructs very similar in what they 
measure, thus needlessly complicating the theory-; hence the requirement of 
discriminant validity* 

The four multitrait-multimethod matrices constructed in this study gave 
essentially the same results concerning the discriminant validity of the 
constructs* Little support was provided for the hypothesis that Level I and 
Level II are distinct, and in general operationalizations of Level I tended to 
correlate more highly with Lt^vcl II operationalizations than with each other* 
Com^>arisonf; amonq the various parts of the matrices also failed to reveal any 
strong method effoct.s, altnough some evidence was found of an effect of group 
vcrs^is individual administration among the Level ii tests* Once more, the lack 
of supixjrt is not surprising in the light of the factor analytic results 
discussed with referoncG to Hypothesis I* 

Each of the method.^ used in forming a multitrait*multimethod matrix serves 
as a counter-hypothesis which may account for observed differences in behavior 
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(Webb, Cairqpbell, Schwart;;, & Sechrest, 1966)* The particular methods 
examined in this study did not prove to be significant determinants of 
behavior* Stevenson et al* (1971) pointed the way toward the examination 
of methods used in this study* Although this research attempted to over- 
come some of the weaknesses in the Stevenson et al* (1971) research, limita- 
tions in the methodology employed in this study preclude drawing definitive 
conclus ions . 



IMPLICATIONS OF THE RESEARCH 

Implications must be drawn from these research findings cautiously, 
given the methodological weaknesses of the study* with so little support 
for the existence of the proposed constructs being found, applications in the 
field of education cannot be seriously considered* The short term rote memory 
factor which emerged in both factor analyses with only the PA test and the 
digit span test loading on it is interpreted as a highly artifactual ability 
which has virtually no application in tlie educational environment* It seems 
that most information which is presentev' in the school situation permits 
organization through any number of strategies or heuristics available; to the 
child* If this argument is valid then of what use is the existence oZ the 
Level I construct, given that it may neither predict nor explain any behavior 
of educational consequence? 

The question of the validity of Level II must also be considered* When 
the 15 variable factor analysis was performed two of the factors which emerged 
were mathematical ability and language ability* The mathematical ability 
factor had only two tests loading significantly on it* SRA Math Concepts and 
SRA Math Computation* The language ability factor had four tests loading on 
it, two of which were subtests of the Gates-MacGinitie Reading Test* when 
the 15 variable multitrait-multimethod matrices were examined there was some 
marginal support for the existence of Level II* These results are of interest 
to the educator, as achievement tests have been used for diagno*^tic and 
selection purposes (Cronbach, 1972)* However, when these lej?s "pure" measures 
are removed for the second factor analysis and the 9 variable mu It it ra it-mult i- 
method matrices are constructed, support for the construct of Level II 
decreases* What remains in terms of the second factor analysis is the strategy 
usage factor and the verbal intelligence factor* An interesting question for 
the educational psychologist is what cioes the strategy usage factor allow us 
to predict or explain in the school situation that could not be predicted by 
using current intelligence tests? Does Level II have much relevance to the 
school environment? since Raven's CPH, figure copying, and categorized free 
recall are the measures of Level II most frequently used in researching the 
construct, while such conventional measures as WISC-R subtests and the stanford- 
,Binet have not been used, the utility of Level II in predicting scholastic 
achievement remains to be established* 

It has been shown that performance on tests which are highly analytic 
in nature, such as the WISC**R block design (vigotsky, 1962), and tests of 
conceptual nititurity such as conservation of weight (smedslund, 1961), may be 
facilitated by direct training* However, Smedslund's (1961) experiment suggests 
that the gains effected by £uch training may be lost when the testing paradigm 
is slightly altered* Cronbach (1972) summarizes research studies of this type 
by saying that responses required by any set of test itans can indeed be taught, 
but educators cannot be interested in training for test tasks alone* The aim 
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of educational intervention is to develop a child's ability to perform on a 
wide range of intellectual tasks* A successful method of training on fiaven's 
CPM, for example, would only contribute to intellectual development if it 
improved a child's performance on other unpracticed tasks as well* Cronbach 
(1972) claims that currently we have no clearly valid methods for developing 
analytic abilities faster than they could emerge in a normally rich environ- 
ment* Given that Level II intelligence was formulated as a highly abstract, 
analytic ability, its relevance to educational intervention is unclear* 
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In the following sections, verbatim instructions prepared for use in 
this study are presented. For the pa task, pictorial stimuli are also 
included* 

WISC-R CODING B 

Look at these divided boxes or squares (point to key). You see each box 
has\ number in the top part and a special mark in 'the bottom part. Each 
number has its own different mark* Wow look down here where it says SAMPLE 
(point to sample), where the boxes have numbers in the top part, tit tbe squares 
on the bottom are empty. You are to put in the empty squares the marks that 
should go there like this (demonstrate using blackboard): Here is a 2. The 2 
has this mark (write in symbol on board)* So I put it in this square like this. 
Here is a !• The 1 has this mark (write synitbol on board). So I put it in this 
square. Now you fill in all of the boxes up to the red line. Don't skip any! 
(Walk around the class to see if they understand*) When I tell you to start, 
you do the rest of them* Begin after the red line and fill in as many squares 
as you can, one after the other, without skipping any* Keep working until I tell 
you to stop* Work as quickly as you can without making mistakes* When you 
finish the first line, go on to the second* Go ahead* Do tiiem in order* Don't 
skip any* (At the end of 120 seconds say) Stop, put your pencils down* 

FREE RECALL (CATEGORIZED AND UNCATE60RI2ED) 

I am going to show you some objects* As I show you each object, tell me 
its name* Look at each object carefully and try to remember it* After I have 
shown you all the objects, I will cjsk you to tell me the names of as many of 
than as you can* Watch carefully* (Present; each object for 2 seconds* With the 
presentation of the first few objects, say) What is this? (After all objects 
are presented, say) Now name as many of the objects as you can* (Allow 90 
seconds for the child to respond* Then say) Good* Now see if you can do as 
well this tim&* (Move the boxes to second predetermined random order* Then 
say) Tell me the name of each object as I show it to you* (Present each object 
for 2 seconds* After all objects are presented, say) Name as many of the 
objects as you can* (Allow 90 seconds for the- child to respond* After child 
finishes naming the objects, say) That was a good job* (As you move the boxes 
to the next predetermined order, say) I will show you the objects two itKDre times. 
Try to do better each time* (Present each of the objects; have child name them. 
Then say) Go ahead* (Allow 90 seconds for the child to respond*) Fine* This 
is the last time* (Move the boxes to the last predetermined order* Then present 
each of the objects t have child name them* Then say) Go ahead* (Allow 90 
seconds for child to respond*) 

PA TASK 

I am going to show you some pairc of pictures* Look at each pair carefully 
and try to remember which pictures go together* After I show you all the pairs # 
I will show you one picture from each pair and ask you what picture goes with it. 
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Let*s try a few. Try to remember which pictures go together, (Present 
example pairing trials at 5 second presentation time. Wait 5 seconds, then 
present singleton pictures. As each singleton is presented say) Tell me 
what goes with this, (if child makes an error, correct him Dy showing the 
card with the correct pair, then continue. After practice test, say) Now 
we are ready to begin. Do you understand what you are to do? There will be 
more pairs this time, so look at each pair carefully, (Present pairs at 5 
second presentation time. When first singleton of the test trial is presented 
say) What goes with this? (Continue presenting singletons. Let child pace 
him/her self, allowing no more than a 10-secom^, presentation for each single- 
ton,) 



DSU RHYMING TASK 

You will have one minute to write doym all the words you can think of 
that rhyme with cat. Begin writing now, (Place placard bearing the word "cat 
on chedk tray. At the end of one minute, say) Stor* Put yotir pencils down. 



PICTORIAL STIMULI USED FOR PA TASK 

The pictures used for the practice test and for the 8*pair Pj\ test are 
presented on the following pages. Pairs are shown as they were presented 
during the study trial. For the test trial, only the left picture from each 
pair was presented. Test trial presentations were in a different order than 
stu-Jy trial presentations. 



Sample pair 1 




Sample paiv 2 




Sample pair 3 
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October 14, 1974 



To the Parents of 



In cooperation with the (name of district] elementary schools, the 
Wisconsin Research and Development Center for Cognitive Learning, a depart- 
ment of the University of Wisconsin, will conduct research from October 7 
to November 7, 1974, in each elementary school* Only students in fifth grade 
are to be included in the study* 

The purpose of the research is to learn more about how children learn* 
The data gathered will shed some light on the acceptability of several recent 
theories about learning and intelligence* Each little bit that we can learn 
will help to improve the educational process in schools* 

This letter is being sent to each fifth grader's parents to tell them 
about the study and to obtain written permission for their child no participate* 
Each child will be given a series of short memory and intelligence tests* 
These will be given during the regular school dav at the diild's school* About 
ninety minutes of testing will be involved* Testing will be done in several 
short sessions, with some tests being given individually and others in class- 
room*->sized groups* 

All test administration will be done by trained personnel fr<:Hti the HfiD 
Center and from the University of Wisconsin School of Education* Children 
usually find these tests to be interesting and even game^like, and respond 
positively during the testing* 

As is customary with iihis type of testing, the test administrators will 
help to make children comfortable and will give encouragement during the 
testing, but they will not give the children an evaluation of their performance 
on the tests* since the tests are experimental, we will not provide the schools 
or teachers with any information on individual children's performance, although 
we will inform them of group sresults* Ko test scores will be enter^ iato. your 
child's school records as a result of this study* 

All data will be treatt^d confidentially by the RsD Center* To assure 
£m:.iymity, children's names will be removed from papers before the data is 
analyzed* No names will be used in the published reports nor will there any 
way to identify an individual's performance* The findings will be expressed in 
terms of the relation^ips among various tests iriiich emerge i4ien large groups 
of scores are considered together* 

We will also need information about each child's school achievement* 
According to Public law 93^380 (the Education Amendments of 1974) and Wisconsin 
Statutes, parents of children participating in such studies are entitled to 
know specifically information from the child's school records will be rsed 

in the study* For the purposes of this study, we would like your permission to 
obtain from your child's school records the Vocabulary and Comprehension sub* 
tost scores from the Gates-HacGinitie Reading Test and the Computation and 
Concepts subtest scores from the Math portion of the SRA skills Profile, both 
administered during the first semester of the 1973-1974 school year* 

Th<- nature and design of the study make it necessary to have certain 
information about each child's family background* The four questions^on the 
attached permission sheet indicate the needed information* You may be assured 
that this information will also be handled in the most confidential manner 
possible* 



98 



90 



When you have completed and signed the form, place it in the envelope 
provided and have your child deliver it to his or her teacher* You may add 
connnents on the margins or back of the form* Even if you should decide for 
some reason not to allow your child to participate, you should return the 
form to the school* This will assure that all have been contacted, and that 
no child will be L^ft out inadvertently* 

If you have a question or desire further Information, contact Geneva 
DiLuzio, who has primary responsibility for this research project* She may 
be reached at the Research and Development Center, 262-4901* 

Your cooperation and assistance are both important and appreciated* 
Every child who participates increases the reliability of the information 
gathered in this study, and the study is designed to improve education for all 
through a better understanding of learning processes* ' 

Host sincerely. 



Geneva DiLuzio 
Evaluation Specialist 

{name o£ superintendent] 
Superintendent of Schools 
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To Geneva DiLuzlo (Wisconsin Research and Development Center for Cognitive 
Learning) and to teachers at n^/our child's school: Permission is hereby 
granted for my/our child, (child's first and last name) to be tested in the 
research study to be conducted by the RCtD Center from approxintately October 7 
through November 7, 1974 in the tnaune of district! schools^ as described in 
Geneva DiLuzio's letter of October 14, 1974. I grant peridssion for the 
release of the Vocabulary and Coo^rehension subtest scores from the Gates- 
HacGinitie Reading Test, and the Confutation and concepts subtest scores 
from the Hath portion of the SKA Skills Profile, both administered during the 
first semester of the 1973-1974 school year to Geneva DiLuzio from existing 
school records for use in this study. X understand that the results of the 
testing will be used in confidence for research purposes only and will not 
become a part of my child's ^ch^ol records* 



(signature of parent/guardian) (date) 

I/We have answered the four questions below in order to give needed family 
informtion about the child^ 

1) How many younger brothers and sisters does the child have? 
n one 
1 or 2 



3 or more 



2) How many older brothers and sisters does the child have? 

none 

1 or 2 



3 or more 



3) The parents* formal education is best described as: (Check one in each 
column) 

Father Mother 

No high school 



Some high school 
High school graduate 
Some college 
College graduate 

Adv£mced degree (please specify what degree) 



92 

4) The present occupation of parents ia; (Former occupation if retired) 

Father 

Mother 

PLEASE HETURN BY; [date one week prior to beginning testing in school,) 

[The actual permission slip and family backgroiand questions were typed on a 
single page» The two parts were cut apart, with only a nunoiber associating 
family background information with the remainder of each child's materials ..J 



101 



National Evaluation Commtttae 



Univtriity <rf On«jj<» 

Mtn Bain 
Past Pttfslilntt 

University of Coloiatto 
Sue Bwl 

IV <Thio linivci*«)iy 
UiiivcrMiy h( 1'iTl<t)n 

Univarsity Advisory Committaa 

R fV T> Ontet 

Oumt^ \{ rVh 
R fV iX cflii't 

u I) r«Eti**f 

l^1llkuhl(n .ihiL lr>\iiuiiiiin 

Itrdvrl j KlaiiMiH^i(>i 

>1(>m1vr *ti ihr F *n uUy 



UnivetSEty flf Illinois 
rbest«t Vt Wmii 

Untv«iK)ty of Cattfotnu Sant^ ^han 
WilltamC Kat^cflineyei 

IXi1(« Univct^tty 

Raibara Hionpvon 

Vu]>riinl4riKicnl of Pbhtir Instfucdon 

JchiMin WtltuMnn 

ridfMviH 

'I'r.u ) vi^ 1 \tlte|te 
f \»)uiia1iM UniverHtty 

3 



AU^Iwi (4 ihe A^v>cuit^l faculty 
R fV I) Ontct 

H«rl>C>nl» 
Richard A Rovsmillfi 

K l>Crni«t 
I I'll Vj^i 



Aftsociatad faculty 

Vt'imiK I All<-i» 
|\v* Ii^i1i>)e> 

II ItlMU ltt»M.1i ^ 

l-MiiUilKHL)) Al^fnl^t^lt1lH1 
'ItuWTLI^ V C.Kt^-nti'i 

>U(ii(i I I r<ill> 

1 iliK .Kdnt-il Vltnift^ti.ithvri 

M.ilttt-niHil II \ 

1 'iiitK iiliim .mil hisliin 

l*'"t^"\Mt) 

( hilit 1^ M'h-iMiM'ni 
ririU-ii [ Kr.insi I 

|p*\i-|ifl i t .itilini 

1 illH ^iIIifiIhII I^sm Itflii)^ 



|iH'( K IrMn 
l'|hU*\ MH 

I jtliKMVhHi.il I'syiliuloK^ 

I Ills 

)n\tiliMhiiLiL SIikIh^s 
|*iiifr\sirf 

riSirnturtkil AilitiinisiLitKriT 
|1iiti^iM N Ml N-MC 

I'M* KKtH 

\ iIlK.lluqLlL /Vlt»tnisimti(Hi 
I ^'r.ilil NhIiHw 

1 Im(ii \1 M.I I ] 'n|(ini'i-( in^ 
Vi^ivm R OMo 

i.\\ttlt llh r»|\l||K tlirti 

itijH'ir ii ivi/oiii 

t >iriii niniii biml lnsthv Mini 



rfnitlLlfv \ i\tfLf>^ tt/ 

AsMsi.uii l^riiti*\strf 
Tuif h iiKiHi -ini] lusttw Imhi 
'IttiHii.Kv A |(«nh.;r|! 

Tuini'vlum Jind In^ttuciion 
KichshiA R<A>iniUpr 

l^ttrCfitwinl AdmiftKi ration 

AMiislm^ Piwfrssni 
I'ducniitHul Ai)inir>i^ttj^ir>n 
Mi<K.i(^l J ^ibkiTVi^Tt 
A^^ifLml IWi'^im 
I'lliK^itiiHin) |^sychoti>){y 
lliilkinl L VriH-rky 
|>rt)lr<fsrjr 

I'imjHiirr 'vcirnfi** 
I l*M'il VpV^Vt'r 
|VJ^•^'^f^f 

( urrit iiliim .tn*! |n*(tiiH Iuhi 
I ^riv M Wiliii'r 
Aif*^r*.t.«iit Vtufc"*^** 
I'hiM iKHi'lujHwflt 



102 



